## Line Chart: JSD vs Token Position
### Overview
The line chart displays the JSD (Joint Similarity Distribution) values across different token positions. The chart shows three different methods: REAP, M-SMoE, and HC-SMoE, each represented by a distinct line color.
### Components/Axes
- **X-axis (Token Position)**: The horizontal axis represents the token positions, ranging from 0 to 20.
- **Y-axis (JSD)**: The vertical axis represents the JSD values, ranging from 0.0 to 0.7.
- **Legend**: The legend on the right side of the chart identifies the three methods used to calculate the JSD.
### Detailed Analysis or ### Content Details
- **REAP**: The blue line shows the highest JSD values, indicating the most similarity between tokens at different positions.
- **M-SMoE**: The light blue line has moderate JSD values, suggesting a balance between similarity and dissimilarity.
- **HC-SMoE**: The yellow line has the lowest JSD values, indicating the least similarity between tokens at different positions.
### Key Observations
- All three methods show an increasing trend in JSD values as the token position increases.
- The REAP method consistently has the highest JSD values, while the HC-SMoE method has the lowest.
- The M-SMoE method shows a more gradual increase in JSD values compared to the other two methods.
### Interpretation
The data suggests that the REAP method captures more similarity between tokens across different positions compared to the M-SMoE and HC-SMoE methods. This could indicate that the REAP method is more effective at identifying and preserving the relationships between tokens in the dataset. The M-SMoE method, while still capturing similarity, does so at a more moderate rate, and the HC-SMoE method, which has the lowest JSD values, may be less effective at preserving the relationships between tokens.