# Technical Document Analysis: Throughput Comparison Chart
## Labels and Axis Titles
- **X-Axis (Categories):**
`MMLU`, `ReAct Agents`, `Generative Agents`, `Tree of Thought`, `Skeleton of Thought`, `LLM Judge`, `HellaSwag`, `JSON Decoding`, `Multi-Turn Chat(short)`, `Multi-Turn Chat(long)`, `DSPy RAG Pipeline`
- **Y-Axis (Normalized Throughput):**
Range: `0.0` to `1.0` (normalized)
- **Legend:**
- Orange: `SGLang`
- Green: `vLLM`
## Chart Structure
- **Bar Chart Format:**
- Each category on the X-axis has two bars (SGLang and vLLM).
- Bars are grouped by category, with SGLang (orange) consistently taller than vLLM (green) across all categories.
## Key Trends and Data Points
1. **SGLang (Orange) Performance:**
- Dominates in all categories, with normalized throughput values consistently above `0.5` (e.g., `Skeleton of Thought` and `Multi-Turn Chat(long)` reach near `1.0`).
- Highest throughput in `Skeleton of Thought` and `Multi-Turn Chat(long)`.
2. **vLLM (Green) Performance:**
- Generally lower throughput than SGLang, with values often below `0.5`.
- Notable exceptions:
- `Tree of Thought`: vLLM reaches `~0.3`.
- `Multi-Turn Chat(long)`: vLLM reaches `~0.7`.
- Lowest throughput in `HellaSwag` (barely visible above `0.0`).
3. **Category-Specific Observations:**
- `MMLU`: SGLang `~1.0`, vLLM `~0.1`.
- `ReAct Agents`: SGLang `~1.0`, vLLM `~0.1`.
- `Generative Agents`: SGLang `~1.0`, vLLM `~0.6`.
- `Tree of Thought`: SGLang `~1.0`, vLLM `~0.3`.
- `Skeleton of Thought`: SGLang `~1.0`, vLLM `~0.8`.
- `LLM Judge`: SGLang `~1.0`, vLLM `~0.5`.
- `HellaSwag`: SGLang `~1.0`, vLLM `~0.0`.
- `JSON Decoding`: SGLang `~1.0`, vLLM `~0.1`.
- `Multi-Turn Chat(short)`: SGLang `~1.0`, vLLM `~0.3`.
- `Multi-Turn Chat(long)`: SGLang `~1.0`, vLLM `~0.7`.
- `DSPy RAG Pipeline`: SGLang `~1.0`, vLLM `~0.1`.
## Notes
- **Normalization:** Throughput values are relative, with `1.0` representing the maximum observed performance.
- **Legend Consistency:** Orange (`SGLang`) and green (`vLLM`) bars are correctly mapped across all categories.
- **Missing Numerical Values:** Exact throughput values are not provided; trends are inferred from bar heights.
