## Chart Analysis: Mean Accuracy of Pruning and Merging Methods
This image presents two grouped bar charts comparing the mean accuracy of different pruning and merging methods at 50% and 25% compression ratios against a 0% baseline. The comparison is conducted across four tasks: Coding, Math, Creative Writing, and MC.
### Chart 1: GLM – 4.5 – Air
**Y-Axis:** Mean Accuracy (%) (Range: 0-90)
**X-Axis:** Tasks (Coding, Math, Creative Writing, MC)
**Legend:**
* **Compression Ratio:**
* 0%: Dashed gray line
* 50%: Solid bar
* 25%: Hatched bar
* **Pruning methods:**
* REAP (ours): Blue
* EAN: Red
* Frequency: Green
* **Merging methods:**
* HC-SMoE: Yellow
* M-SMoE: Light Blue
**Data Table for GLM – 4.5 – Air:**
| Task | Method | 0% Baseline | 50% Compression | 25% Compression |
| :--- | :--- | :--- | :--- | :--- |
| **Coding** | REAP (ours) | ~60% | ~60% | ~51% |
| | EAN | ~60% | ~59% | ~50% |
| | Frequency | ~60% | ~57% | ~32% |
| | HC-SMoE | ~60% | ~57% | ~44% |
| | M-SMoE | ~60% | ~55% | ~30% |
| **Math** | REAP (ours) | ~88% | ~88% | ~86% |
| | EAN | ~88% | ~87% | ~81% |
| | Frequency | ~88% | ~87% | ~61% |
| | HC-SMoE | ~88% | ~87% | ~70% |
| | M-SMoE | ~88% | ~86% | ~46% |
| **Creative Writing** | REAP (ours) | ~84% | ~83% | ~75% |
| | EAN | ~84% | ~82% | ~70% |
| | Frequency | ~84% | ~79% | ~60% |
| | HC-SMoE | ~84% | ~78% | ~59% |
| | M-SMoE | ~84% | ~78% | ~39% |
| **MC** | REAP (ours) | ~75% | ~68% | ~56% |
| | EAN | ~75% | ~63% | ~51% |
| | Frequency | ~75% | ~65% | ~52% |
| | HC-SMoE | ~75% | ~70% | ~56% |
| | M-SMoE | ~75% | ~59% | ~44% |
---
### Chart 2: Qwen3 – 30B – A3B
**Y-Axis:** Mean Accuracy (%) (Range: 0-90)
**X-Axis:** Tasks (Coding, Math, Creative Writing, MC)
**Legend:** (Same as Chart 1)
**Data Table for Qwen3 – 30B – A3B:**
| Task | Method | 0% Baseline | 50% Compression | 25% Compression |
| :--- | :--- | :--- | :--- | :--- |
| **Coding** | REAP (ours) | ~58% | ~58% | ~56% |
| | EAN | ~58% | ~58% | ~55% |
| | Frequency | ~58% | ~58% | ~47% |
| | HC-SMoE | ~58% | ~58% | ~38% |
| | M-SMoE | ~58% | ~56% | ~41% |
| **Math** | REAP (ours) | ~89% | ~89% | ~88% |
| | EAN | ~89% | ~88% | ~86% |
| | Frequency | ~89% | ~88% | ~87% |
| | HC-SMoE | ~89% | ~85% | ~73% |
| | M-SMoE | ~89% | ~84% | ~83% |
| **Creative Writing** | REAP (ours) | ~81% | ~81% | ~72% |
| | EAN | ~81% | ~81% | ~70% |
| | Frequency | ~81% | ~81% | ~68% |
| | HC-SMoE | ~81% | ~81% | ~50% |
| | M-SMoE | ~81% | ~81% | ~73% |
| **MC** | REAP (ours) | ~72% | ~68% | ~55% |
| | EAN | ~72% | ~63% | ~53% |
| | Frequency | ~72% | ~63% | ~52% |
| | HC-SMoE | ~72% | ~67% | ~54% |
| | M-SMoE | ~72% | ~56% | ~45% |
