# Technical Data Extraction: Llama-3.1 Control Precision Analysis
This document provides a comprehensive extraction of data and trends from the provided image, which contains four line charts comparing control precision across different layers and Principal Component (PC) axes for two versions of the Llama-3.1 model.
## 1. Document Structure and Metadata
The image is divided into two primary sections (a and b), each containing two sub-charts.
* **Section a: Llama-3.1 8B**
* Sub-chart 1: Explicit control
* Sub-chart 2: Implicit control
* **Section b: Llama-3.1 70B**
* Sub-chart 1: Explicit control
* Sub-chart 2: Implicit control
### Common Axis Definitions
* **Y-Axis (Logarithmic Scale):** "Control precision". Markers at $10^{-1}$ (0.1), $10^0$ (1), and $10^1$ (10).
* **X-Axis (Categorical/Log-spaced):** "Target PC axis". Markers at 1, 2, 4, 8, 32, 128, 512.
---
## 2. Section a: Llama-3.1 8B
### Legend (Located at [x: right, y: center] of the 8B Implicit chart)
* **Layer 1:** Dark Blue solid line
* **Layer 8:** Purple solid line
* **Layer 16:** Pink solid line
* **Layer 24:** Orange solid line
* **Layer 32:** Yellow solid line
* **Layer mean:** Black dashed line
### Data Trends and Observations
#### Explicit Control (8B)
* **Trend:** Most layers show a peak in precision between PC axis 2 and 8, followed by a sharp decline as the PC axis increases toward 512.
* **Layer 1 (Dark Blue):** Starts high (~8), remains stable until PC 8, then drops sharply to ~0.3 at PC 32 before a slight recovery.
* **Layer 32 (Yellow):** Starts very low (~0.1 at PC 1), rises sharply to peak at PC 2-4 (~6), and then declines.
* **Layer Mean (Dashed):** Follows a bell-shaped curve peaking around PC 4 (~7) and ending near 1.0 at PC 512.
#### Implicit Control (8B)
* **Trend:** Significantly more volatile and lower overall precision compared to explicit control.
* **Layer 1 (Dark Blue):** Shows a general upward trend from PC 1 (~0.3) to PC 512 (~2.0).
* **Layer 32 (Yellow):** Peaks early at PC 2-8 (~4.0) and then gradually declines.
* **Layer Mean (Dashed):** Remains relatively flat, hovering between 1.0 and 3.0 across all PC axes.
---
## 3. Section b: Llama-3.1 70B
### Legend (Located at [x: right, y: center] of the 70B Implicit chart)
* **Layer 1:** Dark Blue solid line
* **Layer 20:** Purple solid line
* **Layer 40:** Pink solid line
* **Layer 60:** Orange solid line
* **Layer 80:** Yellow solid line
* **Layer mean:** Black dashed line
### Data Trends and Observations
#### Explicit Control (70B)
* **Trend:** Similar to the 8B model, there is a peak at lower PC axes (around 8) followed by a decline, though the decline is less "steep" for higher layers compared to the 8B model.
* **Layer 1 (Dark Blue):** Starts high (~7), stays flat until PC 8, then drops to ~0.5 at PC 32.
* **Layer 80 (Yellow):** Starts at ~3, peaks at PC 8 (~6), and maintains a higher precision (~2.5) at PC 512 compared to lower layers.
* **Layer Mean (Dashed):** Peaks at PC 8 (~6) and stabilizes around 1.5-2.0 for higher PC axes.
#### Implicit Control (70B)
* **Trend:** Highly erratic. Unlike the 8B model, the layers do not converge on a single trend.
* **Layer 1 (Dark Blue):** Fluctuates significantly, peaking at PC 8 (~1.2) and dropping to ~0.2 at PC 512.
* **Layer 80 (Yellow):** Generally maintains higher precision than other layers, peaking at PC 128 (~4.0).
* **Layer Mean (Dashed):** Shows a slight upward trend initially, peaking at PC 8 (~3.0), then dipping and recovering slightly to ~1.5 at PC 512.
---
## 4. Comparative Summary Table
| Feature | Llama-3.1 8B | Llama-3.1 70B |
| :--- | :--- | :--- |
| **Max Precision** | ~8.0 (Explicit, Layer 1/8) | ~7.0 (Explicit, Layer 1) |
| **Explicit Trend** | Sharp peak at PC 2-8, then drop. | Peak at PC 8, more sustained at high PC. |
| **Implicit Trend** | Mean is stable around 2.0. | Mean is erratic, peaks at PC 8. |
| **Layer Depth** | 32 Layers analyzed. | 80 Layers analyzed. |
**Note on Language:** All text in the image is in English. No other languages were detected.
