## Line Chart: Qwen3-4B Performance Analysis ### Overview The chart compares the performance of different computational configurations (BF16, INT4, INT4+BDR, KMeans C=2048, Hessian) across varying per-GPU throughput levels. The y-axis measures required tokens per second (TPS_req), while the x-axis represents normalized throughput (TPS_sys/N_GPU, tok/s/GPU). All lines show declining trends, with distinct performance characteristics for each configuration. ### Components/Axes - **Y-axis**: TPS_req (tok/s) ranging from 0 to 175 in 25-unit increments - **X-axis**: Per-GPU throughput (TPS_sys/N_GPU, tok/s/GPU) from 0 to 1600 in 200-unit increments - **Legend**: Positioned at top-right with five color-coded configurations: - Blue: BF16 - Orange: INT4 - Green: INT4+BDR - Red: KMeans C=2048 - Purple: Hessian ### Detailed Analysis 1. **BF16 (Blue Line)**: - Starts at 150 TPS_req at 0 throughput - Gradual decline to 32 TPS_req at 1000 throughput - Steeper drop to 256 TPS_req at 1400 throughput 2. **INT4 (Orange Line)**: - Begins at 180 TPS_req - Consistent decline to 15 TPS_req at 1600 throughput - Maintains higher performance than BF16 throughout 3. **INT4+BDR (Green Line)**: - Highest initial performance at 185 TPS_req - Slightly outperforms INT4 across all throughput levels - Ends at 15 TPS_req at maximum throughput 4. **KMeans C=2048 (Red Line)**: - Sharpest decline from 55 to 5 TPS_req - Collapses below 25 TPS_req after 200 throughput - Most inefficient configuration 5. **Hessian (Purple Line)**: - Starts at 125 TPS_req - Peaks at 140 TPS_req at 800 throughput - Rapid decline to 15 TPS_req at 1600 throughput ### Key Observations - **INT4+BDR** consistently demonstrates the highest performance across all throughput levels - **KMeans C=2048** shows the most dramatic performance degradation - **Hessian** exhibits a unique performance peak at 800 throughput - All configurations converge near 15 TPS_req at maximum throughput (1600) - BF16 maintains better performance than Hessian until 1000 throughput ### Interpretation The data reveals significant performance disparities between configurations. INT4+BDR's consistent superiority suggests it offers optimal balance between throughput and token processing efficiency. The Hessian configuration's performance peak at 800 throughput indicates potential optimization opportunities around this point. KMeans C=2048's rapid decline highlights fundamental inefficiencies in this approach. The convergence at 15 TPS_req at maximum throughput suggests a system-wide limitation or saturation point across all configurations. These findings could inform hardware/software optimization strategies for large-scale language model deployment.