# Technical Document Extraction: Attention over Values, a=20
## Chart Overview
- **Title**: Attention over Values, a=20
- **Type**: Line chart
- **Purpose**: Visualizes throughput (TFLOP/s) across varying hidden sizes for different h/a ratios.
## Axes
- **X-axis (Horizontal)**:
- **Label**: Hidden Size
- **Range**: 0 to 32,768
- **Markers**: Incremental ticks at 0, 4096, 8192, 12288, 16384, 20480, 24576, 28672, 32768.
- **Y-axis (Vertical)**:
- **Label**: Throughput (TFLOP/s)
- **Range**: 0 to 250
- **Markers**: Incremental ticks at 0, 50, 100, 150, 200, 250.
## Legend
- **Location**: Right side of the chart.
- **Labels and Colors**:
- `h/a = 1` → Blue
- `h/a = 2` → Orange
- `h/a = 4` → Green
- `h/a = 8` → Red
- `h/a = 16` → Purple
- `h/a = 32` → Brown
- `h/a = 64` → Pink
## Data Series Analysis
### 1. h/a = 1 (Blue)
- **Trend**: Gradual upward slope with minimal fluctuations.
- **Key Points**:
- Starts at ~0 TFLOP/s at Hidden Size = 0.
- Reaches ~90 TFLOP/s at Hidden Size = 32,768.
### 2. h/a = 2 (Orange)
- **Trend**: Steeper initial rise, then stabilizes with minor oscillations.
- **Key Points**:
- Peaks at ~140 TFLOP/s near Hidden Size = 8,192.
- Ends at ~140 TFLOP/s at Hidden Size = 32,768.
### 3. h/a = 4 (Green)
- **Trend**: Higher baseline than h/a=2, with moderate fluctuations.
- **Key Points**:
- Peaks at ~150 TFLOP/s near Hidden Size = 16,384.
- Ends at ~145 TFLOP/s at Hidden Size = 32,768.
### 4. h/a = 8 (Red)
- **Trend**: Sharp initial rise, followed by volatility and gradual decline.
- **Key Points**:
- Peaks at ~230 TFLOP/s near Hidden Size = 12,288.
- Ends at ~200 TFLOP/s at Hidden Size = 32,768.
### 5. h/a = 16 (Purple)
- **Trend**: High initial throughput, sustained with oscillations.
- **Key Points**:
- Peaks at ~220 TFLOP/s near Hidden Size = 8,192.
- Ends at ~210 TFLOP/s at Hidden Size = 32,768.
### 6. h/a = 32 (Brown)
- **Trend**: Smooth rise with minor fluctuations.
- **Key Points**:
- Peaks at ~210 TFLOP/s near Hidden Size = 16,384.
- Ends at ~210 TFLOP/s at Hidden Size = 32,768.
### 7. h/a = 64 (Pink)
- **Trend**: Highest initial throughput, with significant volatility.
- **Key Points**:
- Peaks at ~240 TFLOP/s near Hidden Size = 4,096.
- Ends at ~220 TFLOP/s at Hidden Size = 32,768.
## Spatial Grounding
- **Legend Placement**: Right-aligned, outside the chart boundary.
- **Color Consistency**: All line colors match legend labels (e.g., blue = h/a=1, pink = h/a=64).
## Key Observations
1. **Throughput vs. h/a**: Higher h/a ratios generally achieve higher throughput but exhibit greater variability.
2. **Hidden Size Impact**: Throughput increases with hidden size up to a point, after which it plateaus or declines slightly.
3. **Volatility**: Larger h/a values (e.g., 64, 32) show more pronounced oscillations compared to smaller ratios (e.g., 1, 2).
## Data Table Reconstruction
| Hidden Size | h/a=1 | h/a=2 | h/a=4 | h/a=8 | h/a=16 | h/a=32 | h/a=64 |
|-------------|-------|-------|-------|-------|--------|--------|--------|
| 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4096 | ~60 | ~90 | ~110 | ~130 | ~150 | ~170 | ~190 |
| 8192 | ~70 | ~140 | ~135 | ~180 | ~200 | ~195 | ~220 |
| 12288 | ~80 | ~130 | ~140 | ~210 | ~215 | ~205 | ~230 |
| 16384 | ~85 | ~135 | ~145 | ~200 | ~210 | ~205 | ~225 |
| 20480 | ~88 | ~140 | ~142 | ~210 | ~205 | ~208 | ~215 |
| 24576 | ~90 | ~145 | ~148 | ~220 | ~210 | ~212 | ~220 |
| 28672 | ~92 | ~150 | ~150 | ~215 | ~218 | ~215 | ~225 |
| 32768 | ~90 | ~145 | ~145 | ~200 | ~210 | ~210 | ~220 |
## Notes
- All numerical values are approximations based on visual inspection of the chart.
- No additional textual or diagrammatic components are present.
