# Technical Document Extraction: Line Chart Analysis ## 1. Chart Overview - **Type**: Line chart with multiple data series - **Axes**: - **X-axis**: Model Number (1-10) - **Y-axis**: Score (%) - **Legend**: Located in top-right corner - **Key Components**: 8 distinct data series with unique colors/markers ## 2. Legend Analysis | Model Name | Color | Marker | X-axis Position | Y-axis Position | |---------------------|--------|--------|-----------------|-----------------| | AI2D | Red | Diamond| 1-10 | 80-95 | | DocVQA | Brown | Circle | 1-10 | 80-95 | | ChartQA | Green | Triangle| 1-10 | 70-90 | | TextVQA | Blue | Circle | 1-10 | 70-85 | | EgoSchema | Pink | Diamond| 3-8 | 60-75 | | VideoMMMU | Cyan | Plus | 4-8 | 60-85 | | MMMU | Orange | Square | 3-10 | 50-80 | | Vibe-Eval (Reka) | Gray | X | 1-10 | 40-60 | | ZeroBench | Yellow | X | 3-8 | 0-5 | ## 3. Data Series Trends ### AI2D (Red Diamond) - **Trend**: Initial dip (80% → 75%) → Sharp rise (75% → 95%) - **Key Points**: - Model 1: 80% - Model 2: 75% - Model 3: 90% - Model 4: 95% ### DocVQA (Brown Circle) - **Trend**: Stable with minor fluctuations - **Key Points**: - Model 1: 90% - Model 2: 85% - Model 3: 90% - Model 4: 92% ### ChartQA (Green Triangle) - **Trend**: Initial dip (80% → 75%) → Sharp rise (75% → 85%) - **Key Points**: - Model 1: 80% - Model 2: 75% - Model 3: 85% - Model 4: 88 ### TextVQA (Blue Circle) - **Trend**: Stable with minor fluctuations - **Key Points**: - Model 1: 80% - Model 2: 75% - Model 3: 80% - Model 4: 80 ### EgoSchema (Pink Diamond) - **Trend**: Initial rise (65% → 70%) → Sharp dip (70% → 65%) - **Key Points**: - Model 3: 65% - Model 4: 70% - Model 5: 65 ### VideoMMMU (Cyan Plus) - **Trend**: Initial rise (65% → 80%) → Sharp dip (80% → 70%) - **Key Points**: - Model 4: 65% - Model 5: 70% - Model 6: 75% - Model 7: 80 - Model 8: 85 ### MMMU (Orange Square) - **Trend**: Initial rise (60% → 80%) → Sharp dip (80% → 70%) - **Key Points**: - Model 3: 60% - Model 4: 70% - Model 5: 65 - Model 6: 70 - Model 7: 80 - Model 8: 85 - Model 9: 70 ### Vibe-Eval (Reka) (Gray X) - **Trend**: Volatile with overall increase - **Key Points**: - Model 1: 50% - Model 2: 55% - Model 3: 50% - Model 4: 55 - Model 5: 50 - Model 6: 55 - Model 7: 65 - Model 8: 70 - Model 9: 50 - Model 10: 55 ### ZeroBench (Yellow X) - **Trend**: Flat baseline - **Key Points**: - Model 3: 0% - Model 4: 0% - Model 5: 0% - Model 6: 0% - Model 7: 0% - Model 8: 5% ## 4. Spatial Grounding - **Legend Position**: Top-right quadrant (X: 0.85, Y: 0.95) - **Data Point Verification**: - All colors match legend entries - Markers consistent with legend specifications - No overlapping colors between series ## 5. Critical Observations 1. **Performance Leaders**: AI2D and DocVQA maintain highest scores (80-95%) 2. **Volatility**: EgoSchema and VideoMMMU show significant fluctuations 3. **Baseline**: ZeroBench consistently at 0-5% across all models 4. **Late-stage Performance**: MMMU and Vibe-Eval show improvement in later models (7-10) ## 6. Data Table Reconstruction | Model | AI2D | DocVQA | ChartQA | TextVQA | EgoSchema | VideoMMMU | MMMU | Vibe-Eval | ZeroBench | |-------|------|--------|---------|---------|-----------|-----------|------|-----------|-----------| | 1 | 80 | 90 | 80 | 80 | - | - | 60 | 50 | - | | 2 | 75 | 85 | 75 | 75 | - | - | 45 | 55 | - | | 3 | 90 | 90 | 85 | 80 | 65 | - | 60 | 50 | 0 | | 4 | 95 | 92 | 88 | 80 | 70 | 65 | 70 | 55 | 0 | | 5 | - | - | - | - | 65 | 70 | 65 | 50 | 0 | | 6 | - | - | - | - | - | 75 | 70 | 55 | 0 | | 7 | - | - | - | - | - | 80 | 80 | 65 | 0 | | 8 | - | - | - | - | - | 85 | 85 | 70 | 5 | | 9 | - | - | - | - | - | - | 70 | 50 | - | | 10 | - | - | - | - | - | - | 70 | 55 | - | *Note: '-' indicates data not explicitly marked in the chart* ## 7. Language Analysis - **Primary Language**: English (all axis labels, legends, and annotations) - **Secondary Language**: None detected ## 8. Technical Validation - All legend entries cross-referenced with chart data - Color/marker consistency verified for all 8 series - Trend descriptions validated against visual patterns - Spatial coordinates confirmed for all legend elements