Multi-Hop Knowledge Graph Question Answering on QALD en 10
70.3Hits@1PrivGemo
Evaluation Results
| Method | Links | |
|---|---|---|
| PrivGemoType=Proposed, Brain LLM=DeepSeek-V3, Hand LLM=Qwen3-32b2026.01 | 70.3 | |
| PrivGemoType=Proposed, Brain LLM=GPT-3.5-Turbo, Hand LLM=Qwen3-32b2026.01 | 68.8 | |
| PrivGemoType=Proposed, Brain LLM=GPT-4o-mini, Hand LLM=Qwen3-32b2026.01 | 61 | |
| Logits-to-LogicBackbone LLM=LLaMA3.1-8b, Reasoning Category=Agentic Reasoning2025.11 | 59.2 | |
| ToGType=KG-centric RAG, LLM=GPT-42026.01 | 54.7 | |
| ToG-RBackbone LLM=GPT4, Reasoning Category=Agentic Reasoning2025.11 | 54.7 | |
| ToG-2Type=KG-centric RAG, LLM=GPT-3.5-Turbo2026.01 | 54.1 | |
| ToGBackbone LLM=GPT4, Reasoning Category=Agentic Reasoning2025.11 | 53.8 | |
| ToGType=KG-centric RAG, LLM=GPT-3.5-Turbo2026.01 | 50.2 | |
| ToGBackbone LLM=ChatGPT, Reasoning Category=Agentic Reasoning2025.11 | 50.2 | |
| ToG-RBackbone LLM=ChatGPT, Reasoning Category=Agentic Reasoning2025.11 | 48.6 | |
| SCType=LLM-only, LLM=GPT-3.5-Turbo2026.01 | 45.3 | |
| SCBackbone LLM=ChatGPT, Reasoning Category=LLMs Reasoning2025.11 | 45.3 | |
| CoTType=LLM-only, LLM=GPT-3.5-Turbo2026.01 | 42.9 | |
| CoTBackbone LLM=ChatGPT, Reasoning Category=LLMs Reasoning2025.11 | 42.9 | |
| IO promptType=LLM-only, LLM=GPT-3.5-Turbo2026.01 | 42 | |
| IO promptBackbone LLM=ChatGPT, Reasoning Category=LLMs Reasoning2025.11 | 42 |