## Line Chart: Different layerwise strategies on LongBench
### Overview
The chart compares four layerwise strategies (Uniform, Var-prop, Var-inv, Pyramid) across varying Heavy Hitter Ratios (0.1–0.9) in terms of LongBench Accuracy (34.5–37.0). All strategies show upward trends, with Pyramid achieving the highest accuracy at most ratios.
### Components/Axes
- **X-axis**: Heavy Hitter Ratio (0.1–0.9, increments of 0.1)
- **Y-axis**: LongBench Accuracy (34.5–37.0, increments of 0.5)
- **Legend**: Located at bottom-right, with:
- Blue line with crosses: Uniform
- Green line with circles: Var-prop
- Red line with squares: Var-inv
- Yellow line with triangles: Pyramid
- **Title**: Positioned at top-center
### Detailed Analysis
1. **Uniform (Blue)**:
- Starts at ~35.0 accuracy at 0.1 ratio.
- Gradual increase to ~36.8 at 0.9.
- Slower growth compared to other strategies after 0.3.
2. **Var-prop (Green)**:
- Begins at ~34.7 at 0.1.
- Steady rise to ~37.0 at 0.9.
- Crosses Uniform at ~0.4 ratio (~35.6 accuracy).
3. **Var-inv (Red)**:
- Starts at ~35.0 at 0.1.
- Sharp ascent to ~37.1 at 0.9.
- Outperforms Uniform and Var-prop until 0.8 ratio.
4. **Pyramid (Yellow)**:
- Lowest start at ~34.6 at 0.1.
- Rapid climb to ~37.2 at 0.3.
- Maintains highest accuracy above 0.3 ratio.
### Key Observations
- **Pyramid strategy** dominates at higher Heavy Hitter Ratios (>0.3), achieving ~37.2 accuracy.
- **Var-inv** and **Var-prop** converge near 37.0 accuracy at 0.9, with Var-inv slightly ahead.
- **Uniform** lags behind all strategies after 0.3 ratio, reaching ~36.8 at 0.9.
- All strategies show diminishing returns as Heavy Hitter Ratio approaches 0.9.
### Interpretation
The data suggests that **Pyramid** and **Var-inv** strategies are most effective for handling heavy hitters, with Pyramid excelling at mid-to-high ratios. The Uniform strategy’s lower performance at higher ratios implies inefficiency in managing concentrated traffic. Var-prop’s consistent growth indicates robustness across varying conditions. The convergence of Var-inv and Var-prop at 0.9 suggests their strategies may be interchangeable for extreme heavy hitter scenarios. The sharp rise of Pyramid at 0.3 hints at a threshold effect, where its architecture becomes particularly advantageous.
