## Bar Chart: Zero-shot Music Tagging @ MagnaTagATune
### Overview
The chart compares zero-shot music tagging performance across four models using PR-AUC (Precision-Recall Area Under the Curve) and ROC-AUC (Receiver Operating Characteristic Area Under the Curve) metrics. Models are ranked by their ROC-AUC scores, with MuQ-MuLan (Ours) achieving the highest performance.
### Components/Axes
- **X-axis**: "Scores" (0–80 range, labeled in increments of 10)
- **Y-axis**: Model names (left-aligned, descending order):
1. MuQ-MuLan (Ours)
2. Google MuLan
3. Microsoft CLAP 2023
4. LAION CLAP
- **Legend**:
- Green: PR-AUC
- Blue: ROC-AUC
- **Bars**: Horizontal bars with distinct colors for PR-AUC (green) and ROC-AUC (blue). All bars extend rightward from the y-axis.
### Detailed Analysis
1. **MuQ-MuLan (Ours)**:
- PR-AUC: ~28 (green bar)
- ROC-AUC: ~80 (blue bar)
2. **Google MuLan**:
- PR-AUC: ~26 (green bar)
- ROC-AUC: ~78 (blue bar)
3. **Microsoft CLAP 2023**:
- PR-AUC: ~28 (green bar)
- ROC-AUC: ~76 (blue bar)
4. **LAION CLAP**:
- PR-AUC: ~24 (green bar)
- ROC-AUC: ~74 (blue bar)
### Key Observations
- **ROC-AUC Dominance**: All models show significantly higher ROC-AUC than PR-AUC, with differences ranging from 46 (LAION CLAP) to 52 (MuQ-MuLan).
- **MuQ-MuLan Superiority**: Outperforms others in both metrics, with ROC-AUC ~80 (highest) and PR-AUC ~28 (tied with Microsoft CLAP 2023).
- **Google MuLan vs. Microsoft CLAP 2023**: Google MuLan has slightly better ROC-AUC (78 vs. 76) but identical PR-AUC (26 vs. 28) to Microsoft CLAP 2023.
- **LAION CLAP**: Lowest performance in both metrics (~24 PR-AUC, ~74 ROC-AUC).
### Interpretation
The chart demonstrates that MuQ-MuLan achieves state-of-the-art zero-shot music tagging performance, with ROC-AUC scores consistently exceeding 74 across all models. The persistent gap between ROC-AUC and PR-AUC suggests that while models effectively rank relevant tags (ROC-AUC), precise retrieval of exact tags (PR-AUC) remains a challenge. MuQ-MuLan's dual leadership in both metrics indicates superior tagging robustness compared to existing solutions like Google MuLan and Microsoft CLAP 2023. The absence of error bars implies these are point estimates, and the lack of gridlines makes exact value verification challenging.
