## Activity Timeline: Robot Proactivity Comparison ### Overview The image presents a series of timeline charts comparing the proactivity of robots with slow, medium, and fast response times across different scenarios (S1-S6). The charts illustrate the timing and sequence of robot-initiated and human-initiated actions, categorized as "Tagging (knowledge acquisition)", "Pointing (knowledge expression)", "Tagging (human points)", "Robot moves object", and "Ask human to move object". The x-axis represents time in seconds, ranging from 0 to 600. ### Components/Axes * **Titles:** * Top Chart: "Slow robot's proactivity" * Middle Chart: "Medium robot's proactivity" * Bottom Chart: "Fast robot's proactivity" * **Y-Axis Labels:** * "Robot initiated" * "Human initiated" * **X-Axis Label:** "Time in s" * **X-Axis Scale:** 0, 100, 200, 300, 400, 500, 600 * **Activity Legend (Left side of each chart):** * Blue: "Tagging (knowledge acquisition)" * Green: "Pointing (knowledge expression)" * Red: "Tagging (human points)" * Orange: "Robot moves object" * Purple: "Ask human to move object" * **Scenario Labels:** S1, S2, S3, S4, S5, S6 * **Arrows:** Black arrows pointing upwards, indicating a specific event. ### Detailed Analysis Each scenario (S1-S6) is divided into two timelines: one for robot-initiated actions and one for human-initiated actions. The colored blocks on the timelines represent the duration and timing of each action. **Slow Robot's Proactivity:** * **S1:** * Robot initiated: "Tagging (knowledge acquisition)" (blue) occurs early, followed by a "Tagging (human points)" (red) event around 150s. "Robot moves object" (orange) occurs around 250s. "Ask human to move object" (purple) occurs around 250s. * Human initiated: "Robot moves object" (orange) occurs around 350s. "Ask human to move object" (purple) occurs around 350s. * **S2:** * Robot initiated: "Tagging (knowledge acquisition)" (blue) occurs early. * Human initiated: "Tagging (human points)" (red) occurs around 250s. "Pointing (knowledge expression)" (green) occurs around 400s. "Robot moves object" (orange) occurs around 500s. "Ask human to move object" (purple) occurs around 500s. **Medium Robot's Proactivity:** * **S3:** * Robot initiated: "Tagging (knowledge acquisition)" (blue) occurs early. "Tagging (human points)" (red) occurs around 100s. "Pointing (knowledge expression)" (green) occurs around 200s. * Human initiated: "Robot moves object" (orange) occurs around 300s. "Ask human to move object" (purple) occurs around 300s. * **S4:** * Robot initiated: "Tagging (knowledge acquisition)" (blue) occurs early. * Human initiated: "Tagging (human points)" (red) occurs around 150s. "Robot moves object" (orange) occurs around 300s. "Pointing (knowledge expression)" (green) occurs around 400s. "Ask human to move object" (purple) occurs around 400s. **Fast Robot's Proactivity:** * **S5:** * Robot initiated: "Tagging (knowledge acquisition)" (blue) occurs early. "Pointing (knowledge expression)" (green) occurs around 100s. * Human initiated: "Robot moves object" (orange) occurs around 300s. "Ask human to move object" (purple) occurs around 300s. * **S6:** * Robot initiated: "Tagging (knowledge acquisition)" (blue) occurs early. "Pointing (knowledge expression)" (green) occurs around 100s. * Human initiated: "Robot moves object" (orange) occurs around 400s. "Ask human to move object" (purple) occurs around 500s. ### Key Observations * "Tagging (knowledge acquisition)" (blue) is consistently initiated by the robot early in each scenario, regardless of robot speed. * The timing of human-initiated actions varies across scenarios and robot speeds. * The "Pointing (knowledge expression)" (green) action appears more frequently with faster robots. * The black arrows point to "Pointing (knowledge expression)" (green) events initiated by the robot. ### Interpretation The charts suggest that robot proactivity, particularly in terms of "Pointing (knowledge expression)", increases with robot speed. The "Tagging (knowledge acquisition)" action is a consistent initial step for the robot, regardless of speed. Human-initiated actions seem to be influenced by the robot's speed and the specific scenario. The data implies a correlation between robot response time and the frequency and timing of certain actions, indicating that faster robots may be more proactive in expressing knowledge. The consistent early "Tagging" suggests a foundational behavior, while the variable human responses highlight the interactive nature of the scenarios.

\n ## Timeline Chart: Robot Proactivity Across Speeds ### Overview The image presents a timeline chart comparing the proactivity of robots operating at three different speeds: Slow, Medium, and Fast. The chart displays the timing of various actions initiated by either the robot or a human during a collaborative task involving object manipulation. Each row represents a single trial (S1-S6), and the chart visualizes the sequence and duration of actions like tagging, pointing, robot movement, and requests for human assistance. ### Components/Axes * **Y-axis:** Represents the trial number, labeled S1 through S6. * **X-axis:** Represents time in seconds (s), ranging from 0 to 600. * **Rows:** Each row corresponds to a single trial. * **Color Coding:** * Red: Tagging (knowledge acquisition) * Green: Pointing (knowledge expression) * Blue: Tagging (human points) * Purple: Robot moves object * Cyan: Ask human to move object * **Initiator Labels:** Each trial is divided into sections labeled "Robot initiated" and "Human initiated", indicating the source of the action. * **Titles:** Each set of trials (S1/S2, S3/S4, S5/S6) is labeled with the robot speed: "Slow robot's proactivity", "Medium robot's proactivity", and "Fast robot's proactivity" respectively. * **Arrows:** Black arrows are present in each set of trials, pointing to specific events on the timeline. ### Detailed Analysis or Content Details **Slow Robot's Proactivity (S1 & S2)** * **S1:** Robot initiates tagging around 20s, pointing around 60s, tagging (human points) around 120s, robot moves object around 180s, and asks human to move object around 300s. * **S2:** Robot initiates tagging around 40s, pointing around 100s, tagging (human points) around 200s, robot moves object around 260s, and asks human to move object around 400s. * The arrow in both S1 and S2 points to the "Ask human to move object" event. **Medium Robot's Proactivity (S3 & S4)** * **S3:** Robot initiates tagging around 20s, pointing around 60s, tagging (human points) around 120s, robot moves object around 180s, and asks human to move object around 240s. * **S4:** Robot initiates tagging around 40s, pointing around 100s, tagging (human points) around 160s, robot moves object around 220s, and asks human to move object around 280s. * The arrow in both S3 and S4 points to the "Ask human to move object" event. **Fast Robot's Proactivity (S5 & S6)** * **S5:** Robot initiates tagging around 20s, pointing around 60s, tagging (human points) around 100s, robot moves object around 140s, and asks human to move object around 180s. * **S6:** Robot initiates tagging around 40s, pointing around 80s, tagging (human points) around 120s, robot moves object around 160s, and asks human to move object around 200s. * The arrow in both S5 and S6 points to the "Ask human to move object" event. ### Key Observations * As robot speed increases, the time at which the robot asks the human to move the object decreases. This suggests that faster robots are more proactive in completing the task independently before requesting assistance. * The sequence of actions (tagging, pointing, tagging human points, robot move, ask human) remains consistent across all speeds. * The duration of each action appears relatively consistent within each speed category, but the overall timeline is compressed for faster robots. * The arrows consistently highlight the "Ask human to move object" event, suggesting this is a key point of comparison across the different robot speeds. ### Interpretation The data demonstrates a clear relationship between robot speed and proactivity. Faster robots exhibit a shorter time to request human assistance, indicating they attempt to complete more of the task autonomously before seeking help. This suggests that increased speed enables the robot to process information and execute actions more efficiently, reducing the need for immediate human intervention. The consistent sequence of actions across all speeds implies a standardized task execution protocol. The robot first acquires knowledge through tagging, expresses its understanding through pointing, identifies relevant human points, attempts to move the object itself, and finally, if necessary, requests human assistance. The arrows focusing on the "Ask human to move object" event highlight the point at which the robot's autonomous capabilities are exhausted. Comparing the timing of this event across different speeds provides a quantifiable measure of the robot's proactivity. The data suggests that increasing robot speed leads to a more proactive and autonomous behavior in this collaborative task. The trials are structured to show the robot's progression through the task, and the consistent structure allows for a direct comparison of the timing of events across different robot speeds.

## Timeline Diagram: Robot-Human Interaction Proactivity Levels ### Overview The image displays a series of six timeline charts (labeled S1 through S6) organized into three main sections based on the robot's proactivity level: "Slow robot's proactivity," "Medium robot's proactivity," and "Fast robot's proactivity." Each chart visualizes the temporal occurrence of specific actions initiated by either a robot or a human over a 600-second period. The charts use color-coded horizontal bars to represent discrete action events. ### Components/Axes * **Main Sections (Top to Bottom):** * Slow robot's proactivity (Contains panels S1 and S2) * Medium robot's proactivity (Contains panels S3 and S4) * Fast robot's proactivity (Contains panels S5 and S6) * **X-Axis (Common to all panels):** Labeled "Time in s" at the bottom of the entire figure. It spans from 0 to 600 seconds, with major tick marks and labels at 0, 100, 200, 300, 400, 500, and 600. A dotted vertical grid aligns with these ticks. * **Panel Structure (S1-S6):** Each panel is a self-contained timeline. The left side of each panel contains a legend defining the action categories. * **Legend (Embedded in each panel, left side):** Actions are grouped by initiator. * **Robot initiated:** * `Tagging (knowledge acquisition)` - Blue bar * `Pointing (knowledge expression)` - Green bar * **Human initiated:** * `Tagging (human points)` - Pink bar * `Robot moves object` - Orange bar * `Ask human to move object` - Purple bar * **Annotations:** Small black upward-pointing arrows (↑) appear in panels S1, S2, S3, S4, and S5, indicating specific moments in time. ### Detailed Analysis **Panel S1 (Slow Proactivity):** * **Robot Actions:** A single, short blue `Tagging` event occurs near t=0s. No green `Pointing` events. * **Human Actions:** A pink `Tagging` event occurs around t=120s. Multiple orange `Robot moves object` events are scattered between ~t=150s and t=350s. A single purple `Ask human to move object` event occurs near t=320s. * **Trend:** Sparse robot activity. Human actions are intermittent, with object movement being the most frequent human-initiated action. **Panel S2 (Slow Proactivity):** * **Robot Actions:** A single blue `Tagging` event near t=0s. Two green `Pointing` events occur between t=400s and t=450s. * **Human Actions:** A pink `Tagging` event near t=220s. Orange `Robot moves object` events occur in three clusters: ~t=100-150s, ~t=280-320s, and a single event near t=480s. Two purple `Ask human to move object` events occur near t=260s and t=500s. * **Trend:** Similar to S1, with delayed and infrequent robot pointing. Human object movement requests are more clustered. **Panel S3 (Medium Proactivity):** * **Robot Actions:** A single blue `Tagging` event near t=0s. Two green `Pointing` events occur between t=200s and t=250s. * **Human Actions:** A pink `Tagging` event near t=100s. Orange `Robot moves object` events occur near t=130s and t=320s. Three purple `Ask human to move object` events occur near t=80s, t=180s, and t=350s. * **Trend:** Robot pointing occurs earlier than in the Slow condition. Human actions are more evenly distributed. **Panel S4 (Medium Proactivity):** * **Robot Actions:** A single blue `Tagging` event near t=0s. Two green `Pointing` events occur near t=250s and t=420s. * **Human Actions:** A pink `Tagging` event near t=180s. A cluster of orange `Robot moves object` events occurs between t=80-120s, with another cluster between t=300-400s. Two purple `Ask human to move object` events occur near t=100s and t=280s. * **Trend:** Robot pointing is delayed. Human object movement requests are highly clustered in two distinct periods. **Panel S5 (Fast Proactivity):** * **Robot Actions:** Three blue `Tagging` events occur in quick succession between t=0-100s. Three green `Pointing` events occur between t=100-250s, with another near t=380s. * **Human Actions:** A single pink `Tagging` event near t=180s. Orange `Robot moves object` events occur near t=320s and t=420s. A single purple `Ask human to move object` event occurs near t=200s. * **Trend:** Marked increase in robot-initiated actions (both tagging and pointing), especially early in the timeline. Human-initiated actions are less frequent. **Panel S6 (Fast Proactivity):** * **Robot Actions:** Three blue `Tagging` events occur between t=0-100s. A dense series of green `Pointing` events occurs throughout the timeline, with clusters near t=100-200s, t=300-400s, and a final event near t=580s. * **Human Actions:** No pink `Tagging` events. Orange `Robot moves object` events occur in a long cluster from ~t=250s to t=600s. Two purple `Ask human to move object` events occur near t=260s and t=410s. * **Trend:** Highest density of robot actions, with pointing being very frequent. Human activity is dominated by a sustained period of requesting object movement in the latter half of the session. ### Key Observations 1. **Proactivity Gradient:** There is a clear visual increase in the frequency and earlier onset of robot-initiated actions (blue and green bars) from the Slow to Fast sections. 2. **Action Sequencing:** In all panels, robot `Tagging (knowledge acquisition)` (blue) is the first action, occurring at or near t=0s. 3. **Human Response Pattern:** Human `Tagging (human points)` (pink) typically occurs after the initial robot tagging. The frequency of human `Ask human to move object` (purple) appears relatively stable across conditions, while `Robot moves object` (orange) shows more variability in clustering. 4. **Arrow Annotations:** The black upward arrows (↑) consistently appear immediately following a human `Tagging (human points)` (pink) event in panels S1, S2, S3, and S4. In S5, the arrow follows a robot `Pointing` event. This suggests the arrow marks a significant event or trigger point in the interaction sequence. 5. **Temporal Clustering:** Human-initiated `Robot moves object` (orange) actions show strong temporal clustering, especially in S4 and S6, indicating periods of concentrated activity. ### Interpretation This diagram illustrates the results of an experiment or observation studying how a robot's level of proactivity (Slow, Medium, Fast) influences the temporal dynamics of a collaborative task with a human. The data suggests that: * **Increased Robot Proactivity Leads to Earlier and More Frequent Robot Initiatives:** The "Fast" condition is characterized by the robot performing knowledge acquisition (tagging) and expression (pointing) actions sooner and more often. This likely represents a robot that is more assertive in sharing information or guiding the task. * **Human Behavior Adapts to Robot Pace:** In the Fast condition (S5, S6), human-initiated tagging is reduced or absent, and human requests for object movement become more sustained (S6). This could indicate the human is following the robot's lead more closely or that the robot's high proactivity reduces the need for the human to initiate certain actions. * **The Interaction is Structured Around Key Events:** The consistent placement of the black arrow after a human tagging event (in most panels) implies this action is a critical juncture, possibly triggering a change in the robot's behavior or the task phase. The exception in S5 (arrow after robot pointing) may indicate a shift in dynamics under high robot proactivity. * **Collaboration Rhythm:** The clustering of human "move object" requests suggests the task has phases of object manipulation. The robot's proactivity level appears to affect the timing and density of these phases, not just the robot's own actions. In essence, the chart provides a visual proof that tuning a robot's proactivity parameter significantly alters the choreography of human-robot interaction, affecting when and how often each agent contributes to the shared task.

## Chart: Robot Proactivity Across Speed Scenarios ### Overview The image is a comparative timeline chart analyzing robot and human-initiated actions across three robot speed scenarios: Slow, Medium, and Fast. Each scenario contains two sub-scenarios (S1-S6), with actions represented as colored bars along a time axis (0–600 seconds). The chart emphasizes differences in task initiation, coordination, and efficiency between robot autonomy and human intervention. --- ### Components/Axes - **X-axis**: "Time in s" (0–600 seconds, linear scale). - **Y-axis**: Scenarios labeled S1–S6, grouped into three sections: - **Slow robot’s proactivity** (top section) - **Medium robot’s proactivity** (middle section) - **Fast robot’s proactivity** (bottom section) - **Legend**: Located on the right, mapping colors to actions: - **Blue**: Tagging (knowledge acquisition) - **Green**: Pointing (knowledge expression) - **Red**: Tagging (human points) - **Orange**: Robot moves object - **Purple**: Ask human to move object --- ### Detailed Analysis #### Slow Robot’s Proactivity - **S1**: - Robot-initiated: - Tagging (blue, ~50s) - Pointing (green, ~100s) - Human-initiated: - Tagging (red, ~150s) - Robot moves object (orange, ~200s) - Ask human to move object (purple, ~250s) - **S2**: - Robot-initiated: - Tagging (blue, ~50s) - Pointing (green, ~100s) - Human-initiated: - Tagging (red, ~150s) - Robot moves object (orange, ~200s) - Ask human to move object (purple, ~250s) #### Medium Robot’s Proactivity - **S3**: - Robot-initiated: - Tagging (blue, ~50s) - Pointing (green, ~100s) - Human-initiated: - Tagging (red, ~150s) - Robot moves object (orange, ~200s) - Ask human to move object (purple, ~250s) - **S4**: - Robot-initiated: - Tagging (blue, ~50s) - Pointing (green, ~100s) - Human-initiated: - Tagging (red, ~150s) - Robot moves object (orange, ~200s) - Ask human to move object (purple, ~250s) #### Fast Robot’s Proactivity - **S5**: - Robot-initiated: - Tagging (blue, ~50s) - Pointing (green, ~100s) - Human-initiated: - Tagging (red, ~150s) - Robot moves object (orange, ~200s) - Ask human to move object (purple, ~250s) - **S6**: - Robot-initiated: - Tagging (blue, ~50s) - Pointing (green, ~100s) - Human-initiated: - Tagging (red, ~150s) - Robot moves object (orange, ~200s) - Ask human to move object (purple, ~250s) --- ### Key Observations 1. **Action Timing**: - Robot-initiated actions (Tagging, Pointing) consistently occur earlier (~50–100s) across all scenarios. - Human-initiated actions (Tagging, Robot moves object, Ask human to move object) cluster between ~150–250s. 2. **Speed Correlation**: - Faster robots show tighter clustering of robot-initiated actions (e.g., S5–S6: Tagging and Pointing overlap at ~50–100s). - Slower robots exhibit more spaced-out human-initiated actions (e.g., S1–S2: Human Tagging at ~150s, Robot moves object at ~200s). 3. **Action Frequency**: - "Ask human to move object" (purple) appears only in human-initiated phases, suggesting reactive human intervention in slower scenarios. 4. **Duration**: - Robot moves object (orange) spans ~200–400s in all scenarios, indicating prolonged execution time. --- ### Interpretation - **Robot Autonomy vs. Human Collaboration**: - Faster robots prioritize autonomous task completion (Tagging/Pointing), while slower robots rely more on human input (Tagging/human points, Ask human to move object). - The "Robot moves object" action dominates across all scenarios, suggesting it is a core task regardless of speed. - **Efficiency Trade-offs**: - Faster robots reduce time between robot-initiated actions but may require more human oversight for complex tasks (e.g., object movement). - Slower robots allow more human intervention but risk delays in task progression. - **Outliers**: - In S1–S2 (Slow), the "Ask human to move object" action occurs later (~250s) compared to faster scenarios, highlighting inefficiency in human-robot coordination under low-speed conditions. --- ### Key Trends - **Time Series**: - Robot-initiated actions (blue/green) precede human-initiated actions (red/orange/purple) in all scenarios. - Faster robots compress the timeline between robot and human actions, while slower robots extend this gap. - **Color Consistency**: - All legend colors (blue, green, red, orange, purple) are consistently applied across scenarios, confirming accurate categorization. --- ### Conclusion The chart demonstrates that robot speed directly impacts task initiation and human-robot collaboration dynamics. Faster robots optimize autonomous workflows, while slower robots necessitate greater human involvement, potentially at the cost of efficiency. This data could inform adaptive robot control systems that balance autonomy and human oversight based on operational speed requirements.