## Chart Type: Zoomed-in ROC Curve ### Overview The image is a Receiver Operating Characteristic (ROC) curve, specifically zoomed-in and plotting the True Positive Rate (TPR) against the False Positive Rate (FPR) on a logarithmic scale. It compares the performance of different models: "Word-S(Context)-0.3", "Word-S(Context)-0.5", "Word-S(Context)-0.7", and "SynthID". The graph shows how well each model distinguishes between positive and negative cases, with a higher curve indicating better performance. ### Components/Axes * **Title:** Zoomed-in ROC Curve (Log-scaled FPR) * **X-axis:** False Positive Rate (FPR, log scale). The scale ranges from 10^-4 to 10^0. Axis markers are present at 10^-4, 10^-3, 10^-2, 10^-1, and 10^0. * **Y-axis:** True Positive Rate (TPR). The scale ranges from 0.90 to 1.00. Axis markers are present at 0.90, 0.92, 0.94, 0.96, 0.98, and 1.00. * **Legend:** Located in the bottom-right corner. It identifies the four data series: * Blue: Word-S(Context)-0.3 (AUC = 0.9990) * Orange: Word-S(Context)-0.5 (AUC = 0.9770) * Green: Word-S(Context)-0.7 (AUC = 0.9493) * Red: SynthID (AUC = 1.0000) * A dashed gray line extends from the bottom-left to the top-right corner, representing a baseline or random classifier. ### Detailed Analysis * **SynthID (Red):** This line is horizontal at TPR = 1.00, indicating perfect classification. * **Word-S(Context)-0.3 (Blue):** The line starts at TPR = 0.90 and rises sharply around FPR = 10^-2, reaching TPR = 0.98, then jumps to 1.00. * **Word-S(Context)-0.5 (Orange):** The line starts at TPR = 0.90 and rises more gradually than the blue line, with steps at approximately FPR = 0.02, 0.04, 0.06, 0.08, 0.1, reaching TPR = 1.00. * **Word-S(Context)-0.7 (Green):** This line rises even more gradually than the orange line, with steps at approximately FPR = 0.2, 0.4, 0.6, 0.8, reaching TPR = 1.00. ### Key Observations * SynthID achieves perfect classification (AUC = 1.0000). * Word-S(Context)-0.3 performs very well (AUC = 0.9990), closely approaching perfect classification. * Word-S(Context)-0.5 (AUC = 0.9770) and Word-S(Context)-0.7 (AUC = 0.9493) have lower AUC scores, indicating slightly worse performance. * The dashed gray line represents a random classifier, against which the models are being compared. ### Interpretation The ROC curve visualizes the trade-off between the true positive rate and the false positive rate for different classification models. The closer a curve is to the top-left corner, the better the model's performance. SynthID demonstrates perfect classification, while Word-S(Context)-0.3 is a close second. The other two models, Word-S(Context)-0.5 and Word-S(Context)-0.7, show progressively lower performance. The logarithmic scale on the x-axis allows for a detailed view of the models' behavior at very low false positive rates. The AUC values provided in the legend quantify the overall performance of each model, confirming the visual assessment.

## Chart: Zoomed-in ROC Curve (Log-scaled FPR) ### Overview The image presents a Receiver Operating Characteristic (ROC) curve, specifically a zoomed-in view with the False Positive Rate (FPR) plotted on a logarithmic scale. The chart compares the performance of four different models or configurations, labeled "Word-S(Context)-0.3", "Word-S(Context)-0.5", "Word-S(Context)-0.7", and "SynthID". The curves illustrate the trade-off between the True Positive Rate (TPR) and the FPR for each model. ### Components/Axes * **Title:** "Zoomed-in ROC Curve (Log-scaled FPR)" - positioned at the top-center of the chart. * **X-axis:** "False Positive Rate (FPR, log scale)" - ranging from 10^-4 to 10⁰ (i.e., 0.0001 to 1). The scale is logarithmic. * **Y-axis:** "True Positive Rate (TPR)" - ranging from 0.90 to 1.00. * **Legend:** Located in the top-right corner of the chart. It identifies each line with its corresponding model name and Area Under the Curve (AUC) value. * "Word-S(Context)-0.3" (AUC = 0.9990) - Blue line * "Word-S(Context)-0.5" (AUC = 0.9770) - Orange line * "Word-S(Context)-0.7" (AUC = 0.9493) - Green line * "SynthID" (AUC = 1.0000) - Red line * **Grid:** A light gray grid is present, aiding in the reading of values. ### Detailed Analysis The chart displays four ROC curves. Let's analyze each one: * **Word-S(Context)-0.3 (Blue):** This line exhibits a very steep initial rise, quickly reaching a TPR of approximately 0.98 at an FPR of around 0.001 (10^-3). It remains at a TPR of nearly 1.0 for the rest of the FPR range. * **Word-S(Context)-0.5 (Orange):** This line starts lower than the blue line, with a TPR of approximately 0.94 at an FPR of around 0.001. It gradually increases, reaching a TPR of approximately 0.98 at an FPR of around 0.01 (10^-2). * **Word-S(Context)-0.7 (Green):** This line has the lowest initial TPR, starting at approximately 0.90 at an FPR of around 0.001. It shows a more gradual increase, reaching a TPR of approximately 0.95 at an FPR of around 0.1 (10^-1). * **SynthID (Red):** This line maintains a TPR of 1.0 across the entire FPR range, indicating perfect classification performance. The AUC values provided in the legend quantify the overall performance of each model. ### Key Observations * The "SynthID" model has a perfect AUC score of 1.0, indicating flawless performance. * "Word-S(Context)-0.3" performs the best among the Word-S models, with an AUC of 0.9990. * As the context value increases from 0.3 to 0.7, the AUC score decreases, suggesting that increasing the context negatively impacts performance. * The curves demonstrate that all models achieve high TPR values, but at varying FPR levels. ### Interpretation This ROC curve analysis suggests that the "SynthID" model is the most effective at distinguishing between positive and negative cases. The "Word-S(Context)" models show a trade-off between TPR and FPR, with lower context values (0.3) leading to better performance. The decreasing AUC scores with increasing context values indicate that incorporating more context may introduce noise or irrelevant information, hindering the model's ability to accurately classify instances. The logarithmic scale on the FPR axis emphasizes the performance of the models at low false positive rates, which is often crucial in applications where minimizing false alarms is paramount. The steep initial rise of the blue line suggests that the "Word-S(Context)-0.3" model can achieve high accuracy with a very low rate of false positives. The chart provides a visual and quantitative comparison of the models' performance, allowing for informed decision-making regarding model selection and parameter tuning.

## Chart Type: Zoomed-in ROC Curve (Log-scaled FPR) ### Overview The image displays a zoomed-in Receiver Operating Characteristic (ROC) curve comparing the performance of three Word-S(Context) models (with context values 0.3, 0.5, and 0.7) against a SynthID baseline. The x-axis uses a logarithmic scale for False Positive Rate (FPR), while the y-axis shows True Positive Rate (TPR). All lines are plotted on a grid with dashed reference lines at TPR=0.98 and FPR=0.01. ### Components/Axes - **X-axis**: False Positive Rate (FPR, log scale) ranging from 10⁻⁴ to 10⁰ (1.0). - **Y-axis**: True Positive Rate (TPR) ranging from 0.90 to 1.00. - **Legend**: - Blue: Word-S(Context)-0.3 (AUC = 0.9990) - Orange: Word-S(Context)-0.5 (AUC = 0.9770) - Green: Word-S(Context)-0.7 (AUC = 0.9493) - Red: SynthID (AUC = 1.0000) - **Grid**: Dashed lines at TPR=0.98 and FPR=0.01 for reference. ### Detailed Analysis 1. **Word-S(Context)-0.3 (Blue Line)**: - Dominates the chart, maintaining TPR ≈ 1.00 across all FPR values. - Sharp drop to TPR=1.00 at FPR=10⁻², then remains flat. - AUC = 0.9990 (highest performance). 2. **Word-S(Context)-0.5 (Orange Line)**: - Starts at TPR=1.00 for FPR < 10⁻². - Gradual decline in TPR as FPR increases, forming a stepwise curve. - AUC = 0.9770 (moderate performance). 3. **Word-S(Context)-0.7 (Green Line)**: - Worst-performing model, with TPR dropping sharply at FPR=10⁻¹. - Steep decline to TPR=0.94 by FPR=10⁻⁰. - AUC = 0.9493 (lowest performance). 4. **SynthID (Red Line)**: - Perfect diagonal line (AUC = 1.0000), representing the theoretical baseline. - No deviation from the 45° reference line. ### Key Observations - **Performance Hierarchy**: Word-S(Context)-0.3 > Word-S(Context)-0.5 > Word-S(Context)-0.7. - **Log Scale Impact**: The logarithmic FPR scale compresses low-FPR regions, emphasizing differences in high-FPR regimes. - **Baseline Anomaly**: SynthID’s AUC=1.0000 is theoretically impossible in practice, suggesting either idealized data or a mislabeled baseline. ### Interpretation The chart demonstrates that reducing context values (e.g., 0.3 vs. 0.7) improves model performance in terms of TPR while maintaining low FPR. The SynthID baseline’s perfect AUC is unrealistic, indicating either a theoretical construct or a data artifact. The zoomed-in view highlights critical performance thresholds near TPR=0.98 and FPR=0.01, where Word-S(Context)-0.3 outperforms others by orders of magnitude in FPR reduction. This suggests context-sensitive tuning is critical for high-stakes applications requiring near-perfect recall.