## Heatmaps: SRCAM Model Performance Comparison ### Overview The image contains four comparative heatmaps (a-d) visualizing performance metrics across different configurations of the SRCAM model. Each heatmap uses a color gradient (light to dark) to represent numerical values, with darker shades indicating higher values. The matrices compare pairwise relationships between 11 categories (bl, cl, co, di, hi, ja, me, po, re, ro, Pr) across four experimental setups. ### Components/Axes - **Rows & Columns**: 11 categories labeled with abbreviations: - bl, cl, co, di, hi, ja, me, po, re, ro, Pr - **Legend**: Implied color scale (light = low values, dark = high values) - **X-axis**: Column categories (same as rows) - **Y-axis**: Row categories (same as columns) - **Annotations**: Numerical values in each cell - **Subtitles**: - (a) SRCAM, ST - (b) SRCAM, ST' - (c) SRCAM, AF' - (d) SRCAM, AF' with relabeling using (3) ### Detailed Analysis #### (a) SRCAM, ST - **Highest Value**: 93.00 (ja row, me column) - **Lowest Value**: 0.00 (multiple cells) - **Notable Pattern**: Diagonal dominance with high values along the main diagonal (e.g., 86.10 at ja/ja) #### (b) SRCAM, ST' - **Highest Value**: 93.62 (ja row, me column) - **Lowest Value**: 0.00 (multiple cells) - **Notable Pattern**: Similar diagonal structure to (a), but with increased values in off-diagonal cells (e.g., 88.00 at cl/cl) #### (c) SRCAM, AF' - **Highest Value**: 88.60 (F row, cl column) - **Lowest Value**: 0.00 (multiple cells) - **Notable Pattern**: More uniform distribution with high values in F row (average across categories) #### (d) SRCAM, AF' with relabeling using (3) - **Highest Value**: 93.38 (Pr row, Pr column) - **Lowest Value**: 0.00 (multiple cells) - **Notable Pattern**: Significant improvement in diagonal values (e.g., 93.38 at Pr/Pr) and reduced off-diagonal variability ### Key Observations 1. **Relabeling Impact**: Heatmap (d) shows consistent improvements in diagonal values (e.g., Pr/Pr increases from 83.50 in (c) to 93.38 in (d)) 2. **Category Performance**: - 'ja' category consistently shows high values across all configurations - 'Pr' category demonstrates the most dramatic improvement in (d) 3. **F Row Trends**: Average performance (F row) increases slightly from (a) 77.70 to (d) 55.80, suggesting overall model improvement ### Interpretation The heatmaps reveal that the SRCAM model's performance improves significantly when combined with relabeling using (3) (configuration d). The diagonal dominance across all configurations suggests the model maintains strong intra-category relationships. The 'F' row averages indicate that relabeling (d) achieves better overall performance despite some category-specific variations. The consistent high values in 'ja' and 'Pr' categories suggest these are particularly well-represented in the model's output space. The relabeling technique appears to enhance model consistency across categories while maintaining strong diagonal relationships.