## Scatter Plot: Pairwise Human Accuracy vs P@1 Retrieval Performance
### Overview
The image is a scatter plot comparing three model configurations (ViT/B-16, RN50x16, RN50x64) across two metrics: Pairwise Human Accuracy (y-axis) and P@1 Retrieval Performance (x-axis). Data points are color-coded and marked with distinct symbols, with a legend in the top-left corner.
### Components/Axes
- **X-axis (P@1 Retrieval Performance)**: Ranges from 24 to 32, with grid lines at integer intervals.
- **Y-axis (Pairwise Human Accuracy)**: Ranges from 16 to 26, with grid lines at integer intervals.
- **Legend**: Located in the top-left corner, mapping:
- Blue circles: ViT/B-16 (ρ=81)
- Orange crosses: RN50x16 (ρ=91)
- Green triangles: RN50x64 (ρ=66)
### Detailed Analysis
1. **ViT/B-16 (Blue Circles)**:
- Data points cluster between x=26–28 and y=18–22.
- Slight upward trend (ρ=81, indicating moderate correlation).
- Example approximate values: (26, 19), (27, 20), (28, 21).
2. **RN50x16 (Orange Crosses)**:
- Data points span x=24–32 and y=16–24.
- Strong upward trend (ρ=91, highest correlation).
- Notable points: (24, 16), (28, 20), (32, 24).
3. **RN50x64 (Green Triangles)**:
- Data points cluster between x=26–30 and y=20–24.
- Downward trend (ρ=66, weakest correlation).
- Example approximate values: (26, 22), (28, 21), (30, 23).
### Key Observations
- **Highest Accuracy**: RN50x16 achieves the highest Pairwise Human Accuracy (up to ~24) at x=32.
- **Lowest Accuracy**: RN50x64 has the lowest accuracy (~16) at x=24.
- **Trade-off**: RN50x64 shows higher P@1 Retrieval Performance (x=30) but lower accuracy compared to RN50x16 at similar x-values.
- **ViT/B-16**: Balanced performance but lags behind RN50x16 in both metrics.
### Interpretation
The data suggests that **RN50x16** optimally balances P@1 Retrieval Performance and Pairwise Human Accuracy, outperforming both ViT/B-16 and RN50x64. The strong positive correlation (ρ=91) for RN50x16 indicates that improvements in retrieval performance directly translate to higher human accuracy. Conversely, RN50x64’s weaker correlation (ρ=66) implies diminishing returns in accuracy despite better retrieval. ViT/B-16’s moderate performance highlights its limitations in scaling. These trends underscore the importance of architectural choices (e.g., model size) in vision-language tasks.
