# Technical Document Extraction: Human-Robot Collaboration Workflow ## Diagram Overview This image depicts a **human-robot collaboration workflow** across seven stages, visualized through a timeline with annotated images and text. The process involves a worker, helper, and robotic system (dyad) interacting in a workspace. Key elements include: - **Worker actions** (e.g., attaching components) - **Helper actions** (e.g., observing, providing corrections) - **System interactions** (e.g., annotation addition, mode switching) - **Temporal progression** (18:50 to 29:06) --- ## Stage-by-Stage Breakdown ### Stage 1 (18:50) - **Worker Action**: Attaches component - **Helper Action**: Observes worker - **System Interaction**: Helper-led mode engaged - **Worker Comment**: *"Does that look right?"* - **Helper Comment**: *"We’ll need this one to be rotated so that there’s two open pegs on the wall"* - **Image**: Worker at desk with robotic arm, laptop, and components ### Stage 2 (20:28) - **Worker Action**: Seeks confirmation - **Helper Action**: Provides correction - **System Interaction**: Annotation added - **Worker Comment**: *"Yup, it’s on the second thing"* - **Helper Comment**: *"Could I help you to see it?"* - **Image**: Worker gesturing toward robotic arm, helper interface overlay ### Stage 3 (21:45) - **Worker Action**: Picks up component - **Helper Action**: Provides instruction - **System Interaction**: Robot-led mode engaged - **Worker Comment**: *"Wait, what?"* - **Helper Comment**: *"It [yellow piece] will go on that same position...have the wording on the other side"* - **Image**: Worker handling components, robotic arm in motion ### Stage 4 (23:27) - **Worker Action**: Attaches recently found component - **Helper Action**: Offers to improve view - **System Interaction**: Helper-led mode engaged - **Worker Comment**: *"Is that [black piece] on top of the piece we just added?"* - **Helper Comment**: *"Alright, excellent"* - **Image**: Worker at desk with robotic arm, helper interface showing 3D model ### Stage 5 (23:50) - **Worker Action**: Offers to move camera - **Helper Action**: Acknowledges view - **System Interaction**: Worker-led mode engaged - **Worker Comment**: *"Could I help you to see it?"* - **Helper Comment**: *"It looks like you have the other piece we need"* - **Image**: Worker adjusting robotic arm, helper interface with 3D annotations ### Stage 6 (24:13) - **Worker Action**: Continues task - **Helper Action**: Monitors worker - **System Interaction**: Helper-led mode + annotation added - **Worker Comment**: *"Wait, what?"* - **Helper Comment**: *"It looks like you have the other piece we need"* - **Image**: Worker at desk with robotic arm, helper interface showing component grid ### Stage 7 (29:06) - **Worker Action**: Locates final component - **Helper Action**: Informs worker - **System Interaction**: Helper-led mode engaged - **Worker Comment**: *"Wait, what?"* - **Helper Comment**: *"It looks like you have the other piece we need"* - **Image**: Worker at desk with robotic arm, helper interface showing final component --- ## Key Trends and Data Points 1. **Temporal Progression**: - Workflow spans **10 minutes and 16 seconds** (18:50–29:06). - Helper-led mode dominates (stages 1, 3, 4, 6, 7), while robot-led mode occurs once (stage 3). 2. **Interaction Patterns**: - Worker seeks confirmation 3x (stages 1, 3, 6). - Helper provides corrections/instructions 4x (stages 2, 3, 4, 7). - System adds annotations 3x (stages 2, 4, 6). 3. **Ambiguity Resolution**: - Worker and helper resolve ambiguities through iterative dialogue (e.g., component rotation, positioning). --- ## Color and Annotation Legend - **Blue**: Worker comments/actions - **Green**: Helper comments/actions - **Orange**: System interactions (annotations, mode switches) --- ## Helper Interface - **Function**: Provides 3D annotations, component positioning guidance, and real-time feedback. - **Examples**: - *"We’ll need this one to be rotated..."* - *"It [yellow piece] will go on that same position..."* --- ## Final Notes - **No numerical data** (e.g., heatmaps, tables) present. - **Primary language**: English. - **Critical components**: Worker-helper dialogue, system annotations, and mode-switching logic.