## Question Answering Performance on Monster Hunter World Attacks ### Overview The image presents a comparison between "Vanilla Answer" and "Augmented Answer" approaches to question answering about Monster Hunter World attacks. It showcases six different scenarios (Individual Information, Action Recognition, Combo Premonition, Condition Awareness, Proc Effect Insight, and Cross Monster Analysis), each with a question, a "Vanilla Answer" (presumably a baseline or simpler approach), and an "Augmented Answer" (presumably a more sophisticated approach). Each scenario also includes a "Retrieved Paths" diagram illustrating the reasoning or knowledge graph used to generate the "Augmented Answer". The performance of the "Augmented Answer" is quantified by Recall and Precision metrics. ### Components/Axes Each of the six scenarios follows a similar structure: * **Scenario Title:** (e.g., "I: Individual Information") Located at the top-left of each scenario block. * **Question:** A question related to Monster Hunter World. * **"Online" Icon:** A magnifying glass icon with the word "Online" next to it, suggesting the information is retrieved from online sources. * **"Vanilla Answer":** A text box containing the answer generated by a baseline approach. It is marked with a red "X" indicating an incorrect or incomplete answer. * **"Augmented Answer":** A text box containing the answer generated by the augmented approach. It is marked with a green checkmark indicating a correct or more complete answer. * **"Retrieved Paths":** A diagram illustrating the reasoning or knowledge graph used to generate the "Augmented Answer". * **Recall and Precision:** Metrics quantifying the performance of the "Augmented Answer". **Diagram Components (Retrieved Paths):** * Nodes: Represent entities (e.g., monsters, attacks, states). * Edges: Represent relationships between entities (e.g., "has", "continues", "mated pair"). * Directional Arrows: Indicate the direction of the relationship. * Images: Small images of the monsters or attacks are sometimes included in the nodes. ### Detailed Analysis or ### Content Details Here's a breakdown of each scenario: **I: Individual Information** * **Question:** "What is the nickname of Tigrex in Monster Hunter World?" * **Vanilla Answer:** "The nickname of Tigrex in 'Monster Hunter: World' is 'The Roaring Wyvern'." (Incorrect) * **Augmented Answer:** "The nickname of Tigrex in the game is the 'Absolutely Strong One'." (Correct) * **Retrieved Paths:** A node for "Tigrex" connected to a text box containing information about Tigrex, including the nickname "Absolutely Strong One". * **Recall:** 1 * **Precision:** 1 **II: Action Recognition** * **Question:** "... showing the beginning of a attack of Kushala Daora. What will happen next within this attack action?" * **Vanilla Answer:** "Kushala Daora will perform a wind-based attack, likely creating a wind pressure or tornado effect in the area." (Incorrect) * **Augmented Answer:** "Kushala Daora will execute the Aerial Crash attack, charging toward hunter seamlessly transitioning into the Ground Phase." (Correct) * **Retrieved Paths:** A diagram showing the flow of Kushala Daora's attacks: Aerial Phase -> Aerial Triple Breath Attack, Aerial Kick, Aerial Super Breath Attack, Aerial Crash -> Ground Phase. * **Recall:** 1 * **Precision:** 0.25 **III: Combo Premonition** * **Question:** "Analyze all possible continues attacks of Zinogre in charged phase after the showing attack." * **Vanilla Answer:** "Zinogre may follow up with the following possible attack actions: Thunder Slam, Pounce Attack, Electric Charge ..." (Incorrect) * **Augmented Answer:** "In charged phase, the possible continued attack actions of Zinogre are: Shoulder Charge and Thunder Charge." (Correct) * **Retrieved Paths:** A diagram showing the possible attacks Zinogre can perform in the charged phase: Zinogre -> Charged Phase -> Thunder Charge, Leap Attack, Shoulder Charge, Heavy Pawslam. * **Recall:** 0.5 * **Precision:** 0.5 **IV: Condition Awareness** * **Question:** "Predict the ongoing attack action Frostfang Barioth will release." * **Vanilla Answer:** "Frostfang Barioth is preparing to release a lunging ice breath attack! soon." (Incorrect) * **Augmented Answer:** "Frostfang Barioth is preparing the 'Aerial Ice Breath' attack or 'Leap Attack'." (Correct) * **Retrieved Paths:** A diagram showing the possible attacks Frostfang Barioth can perform: Frostfang Barioth -> Backstep Ice Breath, Leap Attack, Aerial Ice Breath, Super Fan Slam. * **Recall:** 1 * **Precision:** 0.4 **V: Proc Effect Insight** * **Question:** "What will happens to hunter if hit by Yian Garuga's current attack action?" * **Vanilla Answer:** "If the hunter is hit by this attack, they will take heavy physical damage and potentially be knocked down." (Incorrect) * **Augmented Answer:** "Being hit by Yian Garuga's current attack action will leave the hunter with a poisonous effect." (Correct) * **Retrieved Paths:** A diagram showing the possible effects of Yian Garuga's attacks: Yian Garuga -> Bird Missile, Somersault, Poke, Tail Swing, Enhanced Flame Breath. * **Recall:** 1 * **Precision:** 0.25 **VI: Cross Monster Analysis** * **Question:** "What is the difference between Lunastra and her mated pair for current attack's pattern?" * **Vanilla Answer:** "Lunastra's attack patterns involve creating wide, fiery explosions..., while her mated pair, Teostra, typically ..." (Incorrect) * **Augmented Answer:** "The main differences between... Flame color and effects: Lunastra produces blue flames,.. while Teostra produces orange-yellow flames..." (Correct) * **Retrieved Paths:** A diagram showing the relationship between Lunastra and Teostra and their attacks: Lunastra -> Fire Breath Sweep, Teostra -> Fire Breath, Super Noa, Fire Breath Sweep. * **Recall:** 0.5 * **Precision:** 0.25 ### Key Observations * The "Augmented Answer" consistently provides more accurate or complete answers than the "Vanilla Answer". * The "Retrieved Paths" diagrams illustrate the knowledge graph and reasoning process used by the "Augmented Answer" approach. * The Recall and Precision metrics vary across the scenarios, indicating different levels of performance for the "Augmented Answer" approach depending on the complexity of the question. * The "Online" icon suggests that the information is retrieved from online sources, highlighting the importance of external knowledge in answering these questions. ### Interpretation The image demonstrates the effectiveness of using a knowledge graph and reasoning process to improve the accuracy and completeness of question answering about Monster Hunter World attacks. The "Augmented Answer" approach, which leverages the "Retrieved Paths" diagrams, consistently outperforms the "Vanilla Answer" approach. This suggests that incorporating external knowledge and reasoning capabilities is crucial for answering complex questions about game-related topics. The varying Recall and Precision scores indicate that the performance of the "Augmented Answer" approach is influenced by the complexity of the question and the structure of the underlying knowledge graph. The red X and green checkmarks visually reinforce the superiority of the "Augmented Answer" approach.