## Heatmap: Confidence progression ### Overview A heatmap visualizing confidence progression across iterations for multiple questions. The x-axis represents iterations (0-10), the y-axis lists question IDs (SC, 1-5), and colors indicate confidence levels from -100% (green) to 100% (red). A large green "terminated" region occupies the right side of the plot. ### Components/Axes - **X-axis**: "Number of Iterations" (0-10, linear scale) - **Y-axis**: "Question ID" (SC, 1, 2, 3, 4, 5) - **Legend**: - Green: -100% (terminated) - Purple: -50% - Orange: 0% - Red: 100% - **Title**: "Confidence progression" ### Detailed Analysis - **SC row**: - Iteration 0: Green (-100%) - Iteration 1: Purple (-50%) - Iteration 2: Orange (0%) - Iteration 3: Red (100%) - Iteration 4: Red (100%) - **Question 1**: - Iteration 0: Purple (-50%) - Iteration 1: Orange (0%) - Iteration 2: Red (100%) - Iteration 3: Red (100%) - **Question 2**: - Iteration 0: Orange (0%) - Iteration 1: Red (100%) - Iteration 2: Red (100%) - **Question 3**: - Iteration 0: Green (-100%) - Iteration 1: Purple (-50%) - Iteration 2: Orange (0%) - **Question 4**: - Iteration 0: Purple (-50%) - Iteration 1: Purple (-50%) - Iteration 2: Purple (-50%) - **Question 5**: - Iteration 0: Orange (0%) - Iteration 1: Red (100%) - Iteration 2: Red (100%) ### Key Observations 1. **Termination pattern**: All questions show green (-100%) termination bars starting at iteration 6, occupying 40% of the plot width. 2. **Confidence spikes**: - Question 3 shows the most dramatic progression (green → purple → orange) - Question 5 achieves 100% confidence by iteration 1 3. **Stable low confidence**: Question 4 maintains -50% confidence across all iterations 4. **Early termination**: SC row terminates at iteration 3 (red) but continues to iteration 10 ### Interpretation The heatmap reveals distinct confidence trajectories: - **Rapid learners**: Questions 1, 2, and 5 achieve maximum confidence (red) within 2-3 iterations - **Slow progressors**: Question 3 shows gradual improvement but never reaches 100% confidence - **Persistent uncertainty**: Question 4 maintains moderate uncertainty (-50%) throughout - **Early termination**: The green "terminated" region suggests the system stops processing after iteration 6 for all questions, possibly due to confidence thresholds or resource constraints The data implies an iterative refinement process where most questions resolve quickly (within 3 iterations), while some maintain uncertainty or terminate early. The uniform termination pattern across questions suggests a system-wide cutoff rather than question-specific behavior.