# Technical Document Extraction: MIND - Long-to-Short - Qwen-2.5 7B
## 1. Chart Identification
- **Chart Type**: Heatmap
- **Title**: "MIND - Long-to-Short - Qwen-2.5 7B"
- **Language**: English (no non-English text detected)
## 2. Axis Labels & Markers
- **X-Axis (Horizontal)**:
- Label: "Length"
- Values: 0, 1, 2, 3, 4, 5, 7, 8, 9, 10, 11
- **Y-Axis (Vertical)**:
- Label: "Type"
- Values: 1, 2, 3, 4, 5, 6, 7
- **Colorbar**:
- Label: "Accuracy (%)"
- Range: 0% (lightest green) to 100% (darkest green)
## 3. Data Categories
- **Rows (Type)**: 1–7
- **Columns (Length)**: 0–11
- **Data Points**: Accuracy percentages (%) for each (Type, Length) pair
## 4. Data Table Reconstruction
| Type \ Length | 0 | 1 | 2 | 3 | 4 | 5 | 7 | 8 | 9 | 10 | 11 |
|---------------|-------|-------|-------|-------|-------|-------|-------|-------|-------|-------|-------|
| 1 | 2.0 | 27.0 | 48.3 | 63.0 | 68.3 | - | - | - | - | - | - |
| 2 | - | 56.0 | 92.3 | 98.7 | 99.0 | 97.7 | - | - | - | - | - |
| 3 | 28.3 | 99.0 | 98.7 | 99.0 | 97.0 | - | - | - | - | - | - |
| 4 | 35.0 | 70.0 | 86.7 | 90.7 | 89.0 | - | - | - | - | - | - |
| 5 | - | - | - | - | - | - | 71.3 | 79.0 | 84.0 | 99.3 | 97.3 |
| 6 | 14.0 | 98.3 | 98.3 | 99.7 | 99.7 | - | - | - | - | - | - |
| 7 | 1.0 | 84.7 | 98.0 | 99.0 | 98.7 | - | - | - | - | - | - |
## 5. Key Trends & Observations
- **General Pattern**:
- Accuracy increases with Length for most Types until a peak, then declines.
- Types 2, 3, 6, and 7 show high accuracy (97–99%) at mid-to-high Lengths.
- Type 5 has lower accuracy (71–84%) at mid Lengths but peaks at Length 10 (99.3%).
- **Notable Peaks**:
- Type 2: Length 4 (99.0%)
- Type 3: Length 1 (99.0%)
- Type 6: Length 4 (99.7%)
- Type 7: Length 3 (99.0%)
- **Lowest Accuracy**:
- Type 7, Length 0 (1.0%)
- Type 1, Length 0 (2.0%)
## 6. Legend & Spatial Grounding
- **Legend**: Colorbar on the right side of the heatmap.
- **Color Correlation**: Darker green = higher accuracy (e.g., 99.7% = darkest green).
## 7. Component Isolation
- **Header**: Chart title at the top.
- **Main Chart**: 7x11 grid of accuracy percentages.
- **Footer**: Colorbar with "Accuracy (%)" label.
## 8. Data Validation
- All values match the colorbar's gradient (e.g., 99.7% = dark green).
- Missing values (marked as "-") indicate no data for specific (Type, Length) pairs.
## 9. Summary
The heatmap visualizes the accuracy of the Qwen-2.5 7B model's long-to-short attention mechanism across different input lengths (0–11) and attention types (1–7). Accuracy generally improves with longer input lengths until a peak, after which it declines. Types 2, 3, 6, and 7 demonstrate the highest performance, while Type 5 underperforms at mid-lengths.
