## Chart: Model Performance vs. Budget ### Overview The image is a line chart comparing the performance of two models, "ActPRM" and "Full Data Tuning," as a function of "Budget." Performance is measured by "Average F1 Score." The chart also includes horizontal and vertical dashed lines indicating specific values for F1 score and Budget, respectively. ### Components/Axes * **X-axis:** "Budget," ranging from 0.0 to 1.0 in increments of 0.2. * **Y-axis:** "Average F1 Score," ranging from 0.45 to 0.70 in increments of 0.05. * **Legend (bottom-right):** * "ActPRM" (red line with red data points) * "Full Data Tuning" (blue line with white-filled blue data points) * **Horizontal dashed line:** Indicates F1 = 0.673. * **Vertical dashed line:** Indicates Budget = 0.5. * **Text labels:** "F1 = 0.673" (near the horizontal line) and "Budget = 0.5" (near the vertical line). ### Detailed Analysis * **ActPRM (red):** * Trend: The red line generally slopes upward, indicating increasing F1 score with increasing budget. The slope decreases as the budget approaches 1.0. * Data points: * Budget 0.0: F1 score approximately 0.50 * Budget 0.2: F1 score approximately 0.62 * Budget 0.4: F1 score approximately 0.65 * Budget 0.6: F1 score approximately 0.68 * Budget 0.8: F1 score approximately 0.67 * Budget 1.0: F1 score approximately 0.67 * **Full Data Tuning (blue):** * Trend: The blue line also generally slopes upward, but its increase is less steep than the red line, especially at lower budget values. * Data points: * Budget 0.0: F1 score approximately 0.48 * Budget 0.2: F1 score approximately 0.59 * Budget 0.4: F1 score approximately 0.64 * Budget 0.6: F1 score approximately 0.64 * Budget 0.8: F1 score approximately 0.66 * Budget 1.0: F1 score approximately 0.67 ### Key Observations * At lower budget values (e.g., 0.2), ActPRM outperforms Full Data Tuning. * As the budget increases, the performance of both models converges. * The F1 score of ActPRM plateaus around 0.67 for budgets greater than 0.6. * The F1 score of Full Data Tuning appears to be still increasing slightly at a budget of 1.0. * The horizontal dashed line intersects the ActPRM line near a budget of 0.6 and the Full Data Tuning line near a budget of 1.0. ### Interpretation The chart suggests that ActPRM is more efficient at lower budget levels, achieving a higher F1 score compared to Full Data Tuning with the same budget. However, as the budget increases, the performance gap between the two models diminishes. The horizontal line at F1 = 0.673 indicates a target performance level. ActPRM reaches this level at a lower budget than Full Data Tuning, suggesting it's a more cost-effective option if the goal is to achieve an F1 score of approximately 0.67. The vertical line at Budget = 0.5 could represent a budget constraint, and the chart shows the relative performance of each model under that constraint.

## Line Chart: Average F1 Score vs. Budget ### Overview This chart displays the relationship between "Budget" (on the x-axis) and "Average F1 Score" (on the y-axis) for two different models: "ActPRM" and "Full Data Tuning". The chart uses lines and scatter plots to represent the data, with a dashed horizontal line indicating a reference F1 score of 0.673. A vertical dashed line is present at Budget = 0.5. ### Components/Axes * **X-axis:** "Budget", ranging from 0.0 to 1.0, with markers at 0.0, 0.2, 0.4, 0.6, 0.8, and 1.0. * **Y-axis:** "Average F1 Score", ranging from 0.45 to 0.70, with markers at 0.45, 0.50, 0.55, 0.60, 0.65, and 0.70. * **Legend:** Located in the top-right corner. * "ActPRM" - Represented by a red line with circular markers. * "Full Data Tuning" - Represented by a blue line with circular markers. * **Horizontal Line:** Dashed black line at F1 = 0.673. * **Vertical Line:** Dashed black line at Budget = 0.5. * **Text Annotation:** "Budget = 0.5" positioned near the vertical dashed line. * **Text Annotation:** "F1 = 0.673" positioned near the horizontal dashed line. ### Detailed Analysis **ActPRM (Red Line):** The ActPRM line starts at approximately (0.0, 0.50) and exhibits a steep upward slope until around Budget = 0.3, reaching a peak F1 score of approximately 0.68. After this peak, the line gradually declines, fluctuating around 0.65-0.67 for budgets between 0.4 and 1.0. * (0.0, 0.50) * (0.1, 0.56) * (0.2, 0.60) * (0.3, 0.66) * (0.4, 0.68) * (0.5, 0.67) * (0.6, 0.66) * (0.7, 0.66) * (0.8, 0.66) * (0.9, 0.67) * (1.0, 0.66) **Full Data Tuning (Blue Line):** The Full Data Tuning line begins at approximately (0.0, 0.51) and steadily increases until around Budget = 0.6, reaching a peak F1 score of approximately 0.67. The line then plateaus, remaining relatively stable between 0.66 and 0.68 for budgets between 0.6 and 1.0. * (0.0, 0.51) * (0.1, 0.57) * (0.2, 0.61) * (0.3, 0.64) * (0.4, 0.66) * (0.5, 0.67) * (0.6, 0.68) * (0.7, 0.68) * (0.8, 0.67) * (0.9, 0.67) * (1.0, 0.67) ### Key Observations * ActPRM achieves its peak performance at a lower budget (around 0.4) compared to Full Data Tuning (around 0.6). * Full Data Tuning demonstrates more stable performance at higher budgets, while ActPRM's performance declines slightly after its peak. * Both models show a clear positive correlation between budget and F1 score, at least up to a certain point. * The horizontal line at F1 = 0.673 serves as a benchmark, and Full Data Tuning surpasses this benchmark at budgets greater than 0.5. ### Interpretation The chart suggests that increasing the budget generally improves the F1 score for both models. However, the relationship is not linear, and there appears to be a diminishing return on investment. ActPRM is more sensitive to budget changes, achieving high performance with a smaller budget but also experiencing a decline in performance at higher budgets. Full Data Tuning, while requiring a larger budget to reach its peak, maintains a more consistent level of performance. The vertical line at Budget = 0.5 may indicate a critical point where Full Data Tuning begins to outperform ActPRM consistently. The horizontal line at F1 = 0.673 could represent a target performance level, and the chart helps determine which model is more likely to achieve or exceed this target given a specific budget. The scatter points suggest some variance in performance for each budget level, indicating that the F1 score is not solely determined by the budget. This could be due to factors such as data variability or model initialization.

## Line Graph: Average F1 Score vs. Budget for Two Models ### Overview The image is a line graph comparing the performance of two models (ActPRM and Full Data Tuning) across varying budget levels. The x-axis represents "Budget" (0.0 to 1.0), and the y-axis represents "Average F1 Score" (0.45 to 0.70). Two dashed reference lines are present: a vertical line at Budget = 0.5 and a horizontal line at F1 = 0.673. The graph includes data points with uncertainty (scatter) and trend lines for both models. --- ### Components/Axes - **X-axis (Budget)**: Ranges from 0.0 to 1.0 in increments of 0.1. Labeled "Budget." - **Y-axis (Average F1 Score)**: Ranges from 0.45 to 0.70 in increments of 0.05. Labeled "Average F1 Score." - **Legend**: Located in the bottom-right corner. - Red line with circular markers: "ActPRM" - Blue line with circular markers: "Full Data Tuning" - **Dashed Lines**: - Vertical line at Budget = 0.5 (labeled "Budget = 0.5"). - Horizontal line at F1 = 0.673 (labeled "F1 = 0.673"). --- ### Detailed Analysis #### ActPRM (Red Line) - **Trend**: Starts at ~0.51 F1 at Budget = 0.0, rises sharply to ~0.673 at Budget = 0.5, then fluctuates slightly downward to ~0.66 at Budget = 1.0. - **Key Data Points**: - Budget = 0.0: ~0.51 F1 - Budget = 0.2: ~0.59 F1 - Budget = 0.4: ~0.64 F1 - Budget = 0.5: ~0.673 F1 (peak) - Budget = 0.8: ~0.66 F1 - Budget = 1.0: ~0.66 F1 #### Full Data Tuning (Blue Line) - **Trend**: Starts at ~0.48 F1 at Budget = 0.0, rises steadily, surpassing ActPRM after Budget = 0.5, and plateaus near ~0.68 F1 at Budget = 1.0. - **Key Data Points**: - Budget = 0.0: ~0.48 F1 - Budget = 0.2: ~0.56 F1 - Budget = 0.4: ~0.63 F1 - Budget = 0.5: ~0.64 F1 (overtakes ActPRM) - Budget = 0.8: ~0.67 F1 - Budget = 1.0: ~0.68 F1 #### Scatter Points - Red and blue scatter points (with uncertainty) are distributed around the trend lines, showing variability in performance across trials. --- ### Key Observations 1. **Crossover Point**: Full Data Tuning surpasses ActPRM at Budget = 0.5, where the vertical dashed line is drawn. 2. **F1 Score Threshold**: The horizontal line at F1 = 0.673 indicates a performance benchmark. ActPRM reaches this threshold at Budget = 0.5, while Full Data Tuning exceeds it by Budget = 0.8. 3. **Performance Trends**: - ActPRM shows diminishing returns after Budget = 0.5. - Full Data Tuning demonstrates consistent improvement up to Budget = 1.0. --- ### Interpretation - **Model Efficiency**: Full Data Tuning achieves higher F1 scores with the same or lower budget compared to ActPRM, suggesting better resource utilization. - **Diminishing Returns**: ActPRM’s performance plateaus after Budget = 0.5, indicating limited gains from additional budget allocation. - **Benchmark Significance**: The F1 = 0.673 threshold may represent a target for acceptable performance, with Full Data Tuning being more reliable for exceeding this benchmark. - **Uncertainty**: Scatter points suggest variability in model performance, with ActPRM showing higher variance (wider spread of red points) compared to Full Data Tuning. This analysis highlights the trade-offs between model complexity (ActPRM) and data-driven tuning (Full Data Tuning) in achieving optimal performance under budget constraints.