This image is a box plot chart displaying the distribution of "N-gram diversity" across different "N-gram sizes" for four distinct methods. **1. Chart Type:** Box Plot **2. Axes Information:** * **Y-axis Label:** N-gram diversity * **Y-axis Tick Markers:** 0.2, 0.4, 0.6, 0.8, 1.0 * **X-axis Label:** N-gram size * **X-axis Tick Markers:** 2, 3, 4 **3. Legend Information:** The legend is located in the bottom-center of the main chart area, slightly to the right. It defines the four methods represented by the box plots: * **Grey box:** Baseline * **Dark Blue box:** REAP * **Light Blue box:** M-SMoE * **Khaki/Olive Green box:** HC-SMoE **4. Data Extraction and Trends:** The chart presents four box plots for each N-gram size (2, 3, and 4), corresponding to the four methods. Each box plot visually represents the median, interquartile range (IQR), whiskers, and outliers of the N-gram diversity for that specific method and N-gram size. **General Trends Across N-gram Sizes (2, 3, 4):** * For all four methods, the N-gram diversity generally increases as the N-gram size increases from 2 to 4. * "Baseline" and "REAP" consistently exhibit the highest N-gram diversity, with their distributions being very similar across all N-gram sizes. * "M-SMoE" consistently shows lower N-gram diversity compared to "Baseline" and "REAP", but higher diversity than "HC-SMoE". * "HC-SMoE" consistently demonstrates the lowest N-gram diversity among the four methods and often has a wider spread of data (larger IQR and more outliers), particularly at smaller N-gram sizes. **Detailed Data Points by N-gram Size:** **A. N-gram size = 2:** * **Baseline (Grey):** * **Trend:** High diversity. * **Median:** Approximately 0.82 * **Interquartile Range (IQR):** From approximately 0.79 (Q1) to 0.85 (Q3). * **Whiskers:** Extend from approximately 0.72 (lower) to 0.88 (upper). * **Outliers:** Several data points are observed below the lower whisker, ranging from approximately 0.59 to 0.68. * **REAP (Dark Blue):** * **Trend:** Similar high diversity to Baseline. * **Median:** Approximately 0.82 * **Interquartile Range (IQR):** From approximately 0.79 (Q1) to 0.85 (Q3). * **Whiskers:** Extend from approximately 0.72 (lower) to 0.88 (upper). * **Outliers:** Several data points are observed below the lower whisker, ranging from approximately 0.60 to 0.68. * **M-SMoE (Light Blue):** * **Trend:** Moderate diversity, lower than Baseline and REAP. * **Median:** Approximately 0.78 * **Interquartile Range (IQR):** From approximately 0.72 (Q1) to 0.82 (Q3). * **Whiskers:** Extend from approximately 0.68 (lower) to 0.84 (upper). * **Outliers:** Several data points are observed below the lower whisker, ranging from approximately 0.40 to 0.67. * **HC-SMoE (Khaki/Olive Green):** * **Trend:** Lowest diversity among the methods, with a wide spread. * **Median:** Approximately 0.72 * **Interquartile Range (IQR):** From approximately 0.66 (Q1) to 0.79 (Q3). * **Whiskers:** Extend from approximately 0.50 (lower) to 0.80 (upper). * **Outliers:** Numerous data points are observed below the lower whisker, ranging from approximately 0.25 to 0.48. **B. N-gram size = 3:** * **Baseline (Grey):** * **Trend:** High diversity, increased from N-gram size 2. * **Median:** Approximately 0.92 * **Interquartile Range (IQR):** From approximately 0.90 (Q1) to 0.95 (Q3). * **Whiskers:** Extend from approximately 0.80 (lower) to 0.98 (upper). * **Outliers:** Several data points are observed below the lower whisker, ranging from approximately 0.70 to 0.80. * **REAP (Dark Blue):** * **Trend:** Similar high diversity to Baseline, increased from N-gram size 2. * **Median:** Approximately 0.91 * **Interquartile Range (IQR):** From approximately 0.89 (Q1) to 0.94 (Q3). * **Whiskers:** Extend from approximately 0.80 (lower) to 0.97 (upper). * **Outliers:** Several data points are observed below the lower whisker, ranging from approximately 0.70 to 0.80. * **M-SMoE (Light Blue):** * **Trend:** Moderate diversity, increased from N-gram size 2. * **Median:** Approximately 0.89 * **Interquartile Range (IQR):** From approximately 0.86 (Q1) to 0.92 (Q3). * **Whiskers:** Extend from approximately 0.78 (lower) to 0.95 (upper). * **Outliers:** Several data points are observed below the lower whisker, ranging from approximately 0.50 to 0.77. * **HC-SMoE (Khaki/Olive Green):** * **Trend:** Lowest diversity, increased from N-gram size 2, but still with a wide spread. * **Median:** Approximately 0.85 * **Interquartile Range (IQR):** From approximately 0.78 (Q1) to 0.91 (Q3). * **Whiskers:** Extend from approximately 0.60 (lower) to 0.95 (upper). * **Outliers:** Several data points are observed below the lower whisker, ranging from approximately 0.45 to 0.55. **C. N-gram size = 4:** * **Baseline (Grey):** * **Trend:** Highest diversity, increased from N-gram size 3. * **Median:** Approximately 0.96 * **Interquartile Range (IQR):** From approximately 0.94 (Q1) to 0.98 (Q3). * **Whiskers:** Extend from approximately 0.88 (lower) to 0.99 (upper). * **Outliers:** Several data points are observed below the lower whisker, ranging from approximately 0.78 to 0.87. * **REAP (Dark Blue):** * **Trend:** Similar high diversity to Baseline, increased from N-gram size 3. * **Median:** Approximately 0.95 * **Interquartile Range (IQR):** From approximately 0.93 (Q1) to 0.97 (Q3). * **Whiskers:** Extend from approximately 0.88 (lower) to 0.99 (upper). * **Outliers:** Several data points are observed below the lower whisker, ranging from approximately 0.78 to 0.87. * **M-SMoE (Light Blue):** * **Trend:** Moderate diversity, increased from N-gram size 3. * **Median:** Approximately 0.94 * **Interquartile Range (IQR):** From approximately 0.91 (Q1) to 0.96 (Q3). * **Whiskers:** Extend from approximately 0.85 (lower) to 0.98 (upper). * **Outliers:** Several data points are observed below the lower whisker, ranging from approximately 0.60 to 0.84. * **HC-SMoE (Khaki/Olive Green):** * **Trend:** Lowest diversity, increased from N-gram size 3, but still with a wide spread. * **Median:** Approximately 0.90 * **Interquartile Range (IQR):** From approximately 0.85 (Q1) to 0.95 (Q3). * **Whiskers:** Extend from approximately 0.70 (lower) to 0.98 (upper). * **Outliers:** Several data points are observed below the lower whisker, ranging from approximately 0.35 to 0.68.

# Technical Data Extraction: N-gram Diversity Analysis ## 1. General Overview This image is a grouped box plot illustrating the distribution of **N-gram diversity** scores across four different models/methods, evaluated at three different **N-gram sizes**. ## 2. Axis Information * **Y-Axis Title:** N-gram diversity * **Y-Axis Scale:** Linear, ranging from 0.2 to 1.0 (markers at 0.2, 0.4, 0.6, 0.8, 1.0). * **X-Axis Title:** N-gram size * **X-Axis Categories:** 2, 3, and 4. ## 3. Legend and Color Coding The chart compares four distinct methods, represented by specific colors: * **Baseline:** Grey * **REAP:** Dark Blue/Slate * **M-SMoE:** Light Blue/Cyan * **HC-SMoE:** Olive Green/Gold ## 4. Data Trends and Observations The data is grouped by N-gram size (2, 3, and 4). Within each group, the models are presented in the order listed in the legend (Baseline, REAP, M-SMoE, HC-SMoE). ### Group 1: N-gram size = 2 * **Baseline:** Median ~0.83. Tightest distribution among the four. * **REAP:** Median ~0.82. Slightly lower than Baseline with a few outliers below 0.7. * **M-SMoE:** Median ~0.78. Larger interquartile range (IQR) than REAP, with outliers extending down to ~0.4. * **HC-SMoE:** Median ~0.75. Lowest median in this group, with the largest IQR and outliers extending down to ~0.25. ### Group 2: N-gram size = 3 * **Baseline:** Median ~0.93. High diversity with outliers between 0.7 and 0.8. * **REAP:** Median ~0.92. Very similar to Baseline. * **M-SMoE:** Median ~0.90. Slightly lower median and wider IQR than REAP. * **HC-SMoE:** Median ~0.87. Lowest median in the group, significantly wider IQR, and numerous outliers extending down to ~0.3. ### Group 3: N-gram size = 4 * **Baseline:** Median ~0.97. Highest diversity scores overall. * **REAP:** Median ~0.96. Nearly identical to Baseline. * **M-SMoE:** Median ~0.94. High diversity but with a noticeable spread of outliers down to ~0.4. * **HC-SMoE:** Median ~0.92. Lowest median in the group. Shows the highest variance (largest box and whiskers) and significant outliers reaching as low as ~0.25. ## 5. Key Technical Findings 1. **Positive Correlation:** As the **N-gram size** increases (from 2 to 4), the **N-gram diversity** generally increases for all models. 2. **Performance Hierarchy:** Across all N-gram sizes, the **Baseline** and **REAP** models consistently maintain the highest diversity scores with the lowest variance. 3. **Model Stability:** The **HC-SMoE** model (Olive) consistently exhibits the lowest median diversity and the highest variance/instability, as evidenced by the larger box sizes and the high density of low-value outliers. 4. **Outlier Behavior:** All models show a "bottom-heavy" outlier distribution, indicating that while they usually achieve high diversity, there are specific instances where diversity drops significantly, particularly for the SMoE variants.

## Box Plot Comparison: N-gram Diversity ### Overview The image displays a box plot comparison of N-gram diversity across different N-gram sizes (2, 3, and 4). The plot is divided into three groups, each representing a different method of calculating N-gram diversity: Baseline, REAP, M-SMoE, and HC-SMoE. ### Components/Axes - **X-axis (Horizontal)**: Represents the N-gram size, with values ranging from 2 to 4. - **Y-axis (Vertical)**: Represents the N-gram diversity, with values ranging from 0.2 to 1.0. - **Legend**: Located at the bottom right, it provides color coding for each method. - **Gray**: Baseline - **Blue**: REAP - **Light Blue**: M-SMoE - **Yellow**: HC-SMoE ### Detailed Analysis or ### Content Details - **Baseline**: The box plot for the Baseline method shows a relatively stable N-gram diversity across all N-gram sizes, with a median value slightly above 0.5. - **REAP**: The REAP method exhibits a higher median N-gram diversity compared to the Baseline, with values consistently above 0.5. - **M-SMoE**: The M-SMoE method shows a moderate N-gram diversity, with values slightly above 0.5. - **HC-SMoE**: The HC-SMoE method has the highest N-gram diversity, with values consistently above 0.5. ### Key Observations - **Trend**: All methods show an increase in N-gram diversity as the N-gram size increases. - **Outliers**: There are no significant outliers in any of the methods. - **Variability**: The variability in N-gram diversity is highest for the HC-SMoE method, indicating more fluctuation in diversity across different N-gram sizes. ### Interpretation The data suggests that the HC-SMoE method consistently results in the highest N-gram diversity across all N-gram sizes, indicating a more diverse set of N-grams. The REAP method also shows a high level of diversity, but slightly lower than HC-SMoE. The Baseline and M-SMoE methods have similar levels of diversity, with the Baseline being slightly lower. The trend of increasing diversity with N-gram size is consistent across all methods. The high variability in the HC-SMoE method may indicate that it is more sensitive to changes in the data, leading to more diverse N-grams.

### Technical Description of the Box Plot This image is a box plot illustrating the distribution of "N-gram diversity" across different "N-gram size" categories for four distinct models or methods. #### Axis Information * **Y-axis:** Labeled "N-gram diversity". The axis is marked with numerical values at intervals of 0.2, specifically: 0.2, 0.4, 0.6, 0.8, and 1.0. * **X-axis:** Labeled "N-gram size". The axis is marked with three discrete categories: 2, 3, and 4. #### Legend Information A legend is located in the bottom center-right of the plot, defining the color coding for the four models: * **Gray:** Baseline * **Dark Blue:** REAP * **Light Blue:** M-SMoE * **Gold/Yellow:** HC-SMoE #### Data Analysis by N-gram Size For each N-gram size (2, 3, and 4), four box plots are presented, corresponding to the four models defined in the legend. Each box plot displays the median, interquartile range (IQR), whiskers (representing the range of the data within 1.5 times the IQR from the quartiles), and individual outlier points (represented by open circles). **1. N-gram size: 2** * **Baseline (Gray):** The median is approximately 0.83. The IQR ranges from ~0.79 to ~0.86. Whiskers extend from ~0.68 to ~0.91. Several outliers are present below the lower whisker, down to ~0.59. * **REAP (Dark Blue):** The median is approximately 0.82. The IQR ranges from ~0.78 to ~0.84. Whiskers extend from ~0.69 to ~0.90. Outliers are present below the lower whisker, down to ~0.61. * **M-SMoE (Light Blue):** The median is approximately 0.78. The IQR ranges from ~0.70 to ~0.83. Whiskers extend from ~0.52 to ~0.91. Outliers are present below the lower whisker, down to ~0.23. * **HC-SMoE (Gold):** The median is approximately 0.74. The IQR ranges from ~0.66 to ~0.80. Whiskers extend from ~0.48 to ~0.88. Outliers are present below the lower whisker, down to ~0.28. **2. N-gram size: 3** * **Baseline (Gray):** The median is approximately 0.93. The IQR ranges from ~0.90 to ~0.95. Whiskers extend from ~0.84 to ~0.98. Outliers are present below the lower whisker, down to ~0.69. * **REAP (Dark Blue):** The median is approximately 0.92. The IQR ranges from ~0.89 to ~0.94. Whiskers extend from ~0.84 to ~0.98. Outliers are present below the lower whisker, down to ~0.72. * **M-SMoE (Light Blue):** The median is approximately 0.89. The IQR ranges from ~0.85 to ~0.93. Whiskers extend from ~0.72 to ~0.98. Outliers are present below the lower whisker, down to ~0.51. * **HC-SMoE (Gold):** The median is approximately 0.87. The IQR ranges from ~0.78 to ~0.92. Whiskers extend from ~0.58 to ~0.98. Outliers are present below the lower whisker, down to ~0.46. **3. N-gram size: 4** * **Baseline (Gray):** The median is approximately 0.97. The IQR ranges from ~0.95 to ~0.98. Whiskers extend from ~0.89 to ~1.0. Outliers are present below the lower whisker, down to ~0.75. * **REAP (Dark Blue):** The median is approximately 0.96. The IQR ranges from ~0.94 to ~0.98. Whiskers extend from ~0.89 to ~1.0. Outliers are present below the lower whisker, down to ~0.79. * **M-SMoE (Light Blue):** The median is approximately 0.94. The IQR ranges from ~0.91 to ~0.97. Whiskers extend from ~0.80 to ~1.0. Outliers are present below the lower whisker, down to ~0.26. * **HC-SMoE (Gold):** The median is approximately 0.92. The IQR ranges from ~0.84 to ~0.96. Whiskers extend from ~0.68 to ~1.0. Outliers are present below the lower whisker, down to ~0.36. #### Overall Trends * N-gram diversity generally increases as the N-gram size increases from 2 to 4 for all models. * For a given N-gram size, the Baseline and REAP models tend to have higher median N-gram diversity compared to M-SMoE and HC-SMoE. * M-SMoE and HC-SMoE models show a wider range of diversity values (larger IQR and whisker span) and more pronounced outliers, particularly at the lower end of the diversity scale, compared to Baseline and REAP.

# Technical Document Extraction: N-gram Diversity Analysis ## Chart Description The image presents a comparative box plot analysis of **N-gram diversity** across varying **N-gram sizes** (2, 3, 4) for four computational methods: Baseline, REAP, M-SMoE, and HC-SMoE. The y-axis represents N-gram diversity (0.2–1.0), while the x-axis categorizes data by N-gram size. --- ## Key Components ### Labels & Axis Titles - **Y-axis**: "N-gram diversity" (scale: 0.2–1.0) - **X-axis**: "N-gram size" (categories: 2, 3, 4) - **Legend**: - Gray: Baseline - Dark Blue: REAP - Light Blue: M-SMoE - Gold: HC-SMoE ### Box Plot Structure Each box plot includes: - **Box**: Interquartile range (IQR) of N-gram diversity - **Median line**: Central tendency within the IQR - **Whiskers**: Range excluding outliers - **Outliers**: Represented as open circles --- ## Data Trends ### N-gram Size = 2 - **Baseline**: Median ~0.85 (IQR: ~0.8–0.9) - **REAP**: Median ~0.82 (IQR: ~0.75–0.85) - **M-SMoE**: Median ~0.8 (IQR: ~0.75–0.85) - **HC-SMoE**: Median ~0.75 (IQR: ~0.7–0.8) ### N-gram Size = 3 - **Baseline**: Median ~0.9 (IQR: ~0.85–0.95) - **REAP**: Median ~0.88 (IQR: ~0.83–0.92) - **M-SMoE**: Median ~0.85 (IQR: ~0.8–0.9) - **HC-SMoE**: Median ~0.8 (IQR: ~0.75–0.85) ### N-gram Size = 4 - **Baseline**: Median ~0.92 (IQR: ~0.88–0.95) - **REAP**: Median ~0.9 (IQR: ~0.85–0.93) - **M-SMoE**: Median ~0.88 (IQR: ~0.83–0.92) - **HC-SMoE**: Median ~0.85 (IQR: ~0.8–0.88) --- ## Observations 1. **General Trend**: N-gram diversity decreases as N-gram size increases across all methods. 2. **Method Performance**: - **Baseline** consistently achieves the highest median diversity. - **HC-SMoE** exhibits the lowest median diversity but comparable spread to other methods. - **REAP** and **M-SMoE** show intermediate performance, with REAP slightly outperforming M-SMoE in larger N-gram sizes. 3. **Outliers**: Scattered outliers (open circles) indicate variability in individual data points, particularly for N=2 and N=4. --- ## Transcribed Text - **Legend Labels**: - Baseline - REAP - M-SMoE - HC-SMoE - **Axis Markers**: - Y-axis ticks: 0.2, 0.4, 0.6, 0.8, 1.0 - X-axis ticks: 2, 3, 4 --- ## Conclusion The chart demonstrates that larger N-gram sizes correlate with reduced diversity, with the Baseline method maintaining the highest performance. HC-SMoE underperforms relative to other methods, suggesting potential limitations in its N-gram handling strategy.