# Technical Document Extraction: Human-Robot Collaboration Workflow
## Diagram Overview
This image depicts a **human-robot collaboration workflow** across seven stages, visualized through a timeline with annotated images and text. The process involves a worker, helper, and robotic system (dyad) interacting in a workspace. Key elements include:
- **Worker actions** (e.g., attaching components)
- **Helper actions** (e.g., observing, providing corrections)
- **System interactions** (e.g., annotation addition, mode switching)
- **Temporal progression** (18:50 to 29:06)
---
## Stage-by-Stage Breakdown
### Stage 1 (18:50)
- **Worker Action**: Attaches component
- **Helper Action**: Observes worker
- **System Interaction**: Helper-led mode engaged
- **Worker Comment**: *"Does that look right?"*
- **Helper Comment**: *"We’ll need this one to be rotated so that there’s two open pegs on the wall"*
- **Image**: Worker at desk with robotic arm, laptop, and components
### Stage 2 (20:28)
- **Worker Action**: Seeks confirmation
- **Helper Action**: Provides correction
- **System Interaction**: Annotation added
- **Worker Comment**: *"Yup, it’s on the second thing"*
- **Helper Comment**: *"Could I help you to see it?"*
- **Image**: Worker gesturing toward robotic arm, helper interface overlay
### Stage 3 (21:45)
- **Worker Action**: Picks up component
- **Helper Action**: Provides instruction
- **System Interaction**: Robot-led mode engaged
- **Worker Comment**: *"Wait, what?"*
- **Helper Comment**: *"It [yellow piece] will go on that same position...have the wording on the other side"*
- **Image**: Worker handling components, robotic arm in motion
### Stage 4 (23:27)
- **Worker Action**: Attaches recently found component
- **Helper Action**: Offers to improve view
- **System Interaction**: Helper-led mode engaged
- **Worker Comment**: *"Is that [black piece] on top of the piece we just added?"*
- **Helper Comment**: *"Alright, excellent"*
- **Image**: Worker at desk with robotic arm, helper interface showing 3D model
### Stage 5 (23:50)
- **Worker Action**: Offers to move camera
- **Helper Action**: Acknowledges view
- **System Interaction**: Worker-led mode engaged
- **Worker Comment**: *"Could I help you to see it?"*
- **Helper Comment**: *"It looks like you have the other piece we need"*
- **Image**: Worker adjusting robotic arm, helper interface with 3D annotations
### Stage 6 (24:13)
- **Worker Action**: Continues task
- **Helper Action**: Monitors worker
- **System Interaction**: Helper-led mode + annotation added
- **Worker Comment**: *"Wait, what?"*
- **Helper Comment**: *"It looks like you have the other piece we need"*
- **Image**: Worker at desk with robotic arm, helper interface showing component grid
### Stage 7 (29:06)
- **Worker Action**: Locates final component
- **Helper Action**: Informs worker
- **System Interaction**: Helper-led mode engaged
- **Worker Comment**: *"Wait, what?"*
- **Helper Comment**: *"It looks like you have the other piece we need"*
- **Image**: Worker at desk with robotic arm, helper interface showing final component
---
## Key Trends and Data Points
1. **Temporal Progression**:
- Workflow spans **10 minutes and 16 seconds** (18:50–29:06).
- Helper-led mode dominates (stages 1, 3, 4, 6, 7), while robot-led mode occurs once (stage 3).
2. **Interaction Patterns**:
- Worker seeks confirmation 3x (stages 1, 3, 6).
- Helper provides corrections/instructions 4x (stages 2, 3, 4, 7).
- System adds annotations 3x (stages 2, 4, 6).
3. **Ambiguity Resolution**:
- Worker and helper resolve ambiguities through iterative dialogue (e.g., component rotation, positioning).
---
## Color and Annotation Legend
- **Blue**: Worker comments/actions
- **Green**: Helper comments/actions
- **Orange**: System interactions (annotations, mode switches)
---
## Helper Interface
- **Function**: Provides 3D annotations, component positioning guidance, and real-time feedback.
- **Examples**:
- *"We’ll need this one to be rotated..."*
- *"It [yellow piece] will go on that same position..."*
---
## Final Notes
- **No numerical data** (e.g., heatmaps, tables) present.
- **Primary language**: English.
- **Critical components**: Worker-helper dialogue, system annotations, and mode-switching logic.