# Technical Data Extraction: Layer-wise Accuracy Performance
## 1. Document Overview
This image contains a grid of 32 line charts (arranged in a 6x6 grid, with the last row containing 2 charts and a legend). The charts visualize the "Accuracy" of different models or components across 32 sequential layers (Layer 0 through Layer 31) of a neural network or similar architecture.
## 2. Global Chart Metadata
* **Type:** Multi-panel line plots (Small Multiples).
* **X-axis (Bottom Row Only):** Numerical scale representing training steps or samples. Markers are at **250** and **500**.
* **Y-axis (All Panels):** Labeled "Accuracy". Numerical markers are at **0.50** and **0.75**.
* **Legend Location:** Bottom right corner (replaces the slots for Layers 32-35).
## 3. Legend and Series Identification
The legend maps specific colors to model types or Principal Component (PC) configurations. The series are ordered by performance/complexity:
| Color | Label | Visual Trend Description |
| :--- | :--- | :--- |
| **Red** | **LR** | Highest accuracy. Starts high (~0.75) and remains stable or slightly improves across layers. |
| **Yellow** | **PC1** | High variability. In early layers, it is near the top; in middle layers, it drops; in late layers, it recovers slightly. |
| **Light Green** | **PC2** | Generally follows PC1 but with slightly lower accuracy in early layers. |
| **Medium Green** | **PC4** | Mid-tier performance. Shows a steady upward slope within each panel. |
| **Teal** | **PC8** | Mid-to-low tier. Slopes upward but stays below PC4. |
| **Blue-Grey** | **PC32** | Low performance. Slopes upward slightly but remains near the 0.50 baseline. |
| **Dark Purple** | **PC128** | Very low performance. Clustered near the 0.50 baseline with high noise. |
| **Deep Violet** | **PC512** | Lowest performance. Often indistinguishable from the 0.50 baseline. |
## 4. Component Analysis by Layer Groups
### Early Layers (Layer 0 - Layer 5)
* **Trend:** Significant spread between the series.
* **Observation:** PC1 (Yellow) and PC2 (Light Green) perform exceptionally well here, nearly matching the LR (Red) baseline by Layer 5. Accuracy for most series starts at ~0.50 and climbs rapidly within the first 250 units of the x-axis.
### Middle Layers (Layer 6 - Layer 17)
* **Trend:** The LR (Red) series stabilizes at its peak (~0.85).
* **Observation:** There is a noticeable "dip" or reorganization of the PC series. PC1 (Yellow) begins to drop below the green series (PC2, PC4) in Layers 12-17. The gap between the high-performing red line and the low-performing purple lines is at its widest.
### Late Layers (Layer 18 - Layer 31)
* **Trend:** Convergence of the mid-tier PC series.
* **Observation:** In the final layers (24-31), the PC4 (Medium Green) and PC8 (Teal) series show more robust upward trends, while PC1 (Yellow) remains significantly lower than its performance in Layer 0. The LR (Red) line remains the consistent ceiling of performance across all layers.
## 5. Data Table Reconstruction (Representative Values)
*Values are estimated based on visual positioning relative to the 0.50 and 0.75 markers.*
| Layer | LR (Red) | PC1 (Yellow) | PC4 (Green) | PC512 (Purple) |
| :--- | :--- | :--- | :--- | :--- |
| **Layer 0** | ~0.75 | ~0.70 | ~0.60 | ~0.50 |
| **Layer 10** | ~0.85 | ~0.70 | ~0.75 | ~0.52 |
| **Layer 20** | ~0.85 | ~0.65 | ~0.70 | ~0.52 |
| **Layer 31** | ~0.85 | ~0.68 | ~0.75 | ~0.55 |
## 6. Summary of Findings
1. **LR (Logistic Regression/Linear Baseline):** Consistently provides the highest accuracy (~0.80 - 0.85) across all layers.
2. **Dimensionality Inverse Relationship:** Generally, lower PC counts (PC1, PC2) perform better in very early layers, while mid-range PCs (PC4, PC8) become more competitive in later layers.
3. **High-Dimensional Noise:** PC128 and PC512 consistently fail to achieve significant accuracy, hovering near the 0.50 (likely chance-level) mark regardless of the layer depth.
4. **Learning Curve:** Almost all series exhibit a logarithmic growth curve within each layer's individual timeline, with the sharpest gains occurring before the 250-step mark.
