# Technical Document Extraction: Attention over Values (a=512)
## Chart Overview
- **Title**: Attention over Values, a=512
- **Type**: Line chart
- **Purpose**: Visualizes throughput (TFLOP/s) across hidden sizes for different h/a ratios
## Axes
- **X-axis (Horizontal)**:
- Label: Hidden Size
- Range: 0 → 32768
- Tick Intervals: 4096, 8192, 12288, 16384, 20480, 24576, 28672, 32768
- **Y-axis (Vertical)**:
- Label: Throughput (TFLOP/s)
- Range: 0 → 50
- Tick Intervals: 10, 20, 30, 40, 50
## Legend
- **Location**: Right side of chart
- **Color-Coded h/a Ratios**:
- Blue: h/a = 1
- Orange: h/a = 2
- Green: h/a = 4
- Red: h/a = 8
- Purple: h/a = 16
- Brown: h/a = 32
- Pink: h/a = 64
## Data Series Analysis
1. **h/a = 1 (Blue Line)**
- **Trend**: Gradual upward slope with minor fluctuations
- **Key Points**:
- (0, 0)
- (4096, ~5)
- (8192, ~15)
- (12288, ~20)
- (16384, ~25)
- (20480, ~28)
- (24576, ~32)
- (28672, ~38)
- (32768, ~40)
2. **h/a = 2 (Orange Line)**
- **Trend**: Steeper than h/a=1, nearly linear
- **Key Points**:
- (0, 0)
- (4096, ~10)
- (8192, ~20)
- (12288, ~25)
- (16384, ~30)
- (20480, ~35)
- (24576, ~40)
- (28672, ~45)
- (32768, ~48)
3. **h/a = 4 (Green Line)**
- **Trend**: Steeper than h/a=2, linear with slight curvature
- **Key Points**:
- (0, 0)
- (4096, ~15)
- (8192, ~30)
- (12288, ~35)
- (16384, ~40)
- (20480, ~45)
- (24576, ~50)
- (28672, ~55)
- (32768, ~58)
4. **h/a = 8 (Red Line)**
- **Trend**: Steepest linear increase
- **Key Points**:
- (0, 0)
- (4096, ~20)
- (8192, ~40)
- (12288, ~50)
- (16384, ~60)
- (20480, ~70)
- (24576, ~80)
- (28672, ~90)
- (32768, ~95)
5. **h/a = 16 (Purple Line)**
- **Trend**: Linear with slight curvature
- **Key Points**:
- (0, 0)
- (4096, ~25)
- (8192, ~50)
- (12288, ~65)
- (16384, ~80)
- (20480, ~95)
- (24576, ~110)
- (28672, ~125)
- (32768, ~130)
6. **h/a = 32 (Brown Line)**
- **Trend**: Linear with slight curvature
- **Key Points**:
- (0, 0)
- (4096, ~30)
- (8192, ~60)
- (12288, ~80)
- (16384, ~100)
- (20480, ~120)
- (24576, ~140)
- (28672, ~160)
- (32768, ~170)
7. **h/a = 64 (Pink Line)**
- **Trend**: Linear with slight curvature
- **Key Points**:
- (0, 0)
- (4096, ~35)
- (8192, ~70)
- (12288, ~90)
- (16384, ~110)
- (20480, ~130)
- (24576, ~150)
- (28672, ~170)
- (32768, ~185)
## Spatial Grounding
- **Legend Position**: Right-aligned, outside the plot area
- **Color Consistency**: All lines match legend colors exactly
- **Overlap Note**: h/a=1 (blue) and h/a=2 (orange) lines nearly overlap in early x-axis range
## Trend Verification
- All lines show **positive correlation** between hidden size and throughput
- Higher h/a ratios demonstrate **steeper slopes** (e.g., h/a=64 > h/a=32 > h/a=16)
- No lines exhibit negative trends or plateaus
- h/a=8 (red) and h/a=16 (purple) lines show most aggressive growth
## Component Isolation
1. **Header**: Chart title centered at top
2. **Main Chart**:
- Axes with labeled ticks
- Seven distinct data series
3. **Footer**: No footer elements present
## Critical Observations
- Throughput scales linearly with hidden size for all h/a ratios
- h/a=64 achieves highest throughput at maximum hidden size (32768)
- h/a=1 shows lowest throughput across all hidden sizes
- All lines originate from (0,0) point
- No data points fall outside expected linear progression
