## Flowchart: Comparative Analysis of Question Answering Methods for Incomplete Knowledge Graphs
### Overview
The diagram compares three approaches to answering complex questions about film releases and screenwriters using incomplete knowledge graphs (KG). It visually demonstrates failure modes of traditional methods and validates a proposed multi-turn interaction strategy.
### Components/Axes
1. **Semantic Parsing Methods** (Top Section)
- Input: Hand with question bubble ("When did the films release whose screenwriters also wrote Analyze That?")
- Process: SPARQL query execution
- Output: Red X → "Incomplete KG" → "No Answer"
2. **Retrieval-Augmented Methods** (Middle Section)
- Input: Decomposed questions:
- "Which screenwriters wrote Analyze That?" (Red X → "Decompose Error")
- "When was Harold Ramis released?" (Red X → "No Answer")
- Output: Cyclic dependency → "Incomplete KG" → "No Answer"
3. **Proposed Method** (Bottom Section)
- Input: Multi-turn interaction between AI and user
- Process:
- Step 1: SearchKG(screenwriter|Analyze That?) → Ans1
- Step 2: SearchKG(films|Ans1) → Ans2
- Step 3: SearchKG(time|Ans2) → Ans3
- Output: Green checkmark → "1999" (correct answer)
### Detailed Analysis
- **KG Representation**:
- Incomplete KG shown as fragmented node networks (blue nodes with purple edges)
- Web interface depicted with code snippets (HTML/CSS/JS) and database icons
- **Method Comparison**:
- Semantic Parsing: Direct query fails due to KG incompleteness
- Retrieval-Augmented: Question decomposition fails due to missing entity links
- Proposed Method: Iterative KG queries successfully resolve through entity chaining
### Key Observations
1. **Failure Patterns**:
- All methods fail when facing entity disambiguation (e.g., "Analyze That" vs. "Harold Ramis")
- Cyclic dependencies in retrieval-augmented approaches create infinite loops
2. **Success Factors**:
- Multi-turn interaction enables progressive query refinement
- Entity chaining (screenwriter → films → release date) resolves KG gaps
- Temporal resolution (1999) requires cross-domain KG integration
### Interpretation
The diagram reveals fundamental limitations in current QA systems when facing incomplete KGs:
1. **Structural Weakness**: Traditional methods assume perfect KG coverage, failing when entities or relations are missing
2. **Query Complexity**: Multi-hop questions require contextual understanding beyond simple key-value lookups
3. **Proposed Solution**: The multi-turn approach mimics human reasoning by:
- Breaking complex queries into atomic sub-questions
- Using intermediate answers to guide subsequent searches
- Leveraging web resources to compensate for KG gaps
This suggests that effective QA systems must combine:
- KG query capabilities
- Web search integration
- Conversational context management
- Entity resolution mechanisms
