Knowledge Graph Question Answering on GrailQA (Overall)
86.4Hits@1CoG
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| CoGMethod category=Prompting KG-Augmented LLM, Backbone LLM=GPT-42026.01 | 86.4 | — | |
| KG-AgentMethod category=Fine-Tuned KG-Augmented LLM2026.01 | 86.1 | — | |
| PoGMethod category=Prompting KG-Augmented LLM, Backbone LLM=GPT-42026.01 | 84.7 | — | |
| ToGMethod category=Prompting KG-Augmented LLM, Backbone LLM=GPT-42026.01 | 81.4 | — | |
| CoGMethod category=Prompting KG-Augmented LLM, Backbone LLM=GPT-3.5 or others2026.01 | 79.2 | — | |
| PoGMethod category=Prompting KG-Augmented LLM, Backbone LLM=GPT-3.5 or others2026.01 | 76.5 | — | |
| GAINMethod category=Fine-Tuned KG-Augmented LLM2026.01 | 76.3 | — | |
| PanguMethod category=Fine-Tuned KG-Augmented LLM2026.01 | 75.4 | — | |
| FC-KBQAMethod category=Fine-Tuned KG-Augmented LLM2026.01 | 73.2 | — | |
| TIARAMethod category=Fine-Tuned KG-Augmented LLM2026.01 | 73 | — | |
| CoGMethod category=Prompting KG-Augmented LLM, Backbone LLM=Qwen2.5-7B2026.01 | 72 | — | |
| PoGMethod category=Prompting KG-Augmented LLM, Backbone LLM=Qwen2.5-7B2026.01 | 68.9 | — | |
| RnG-KBQAMethod category=Fine-Tuned KG-Augmented LLM2026.01 | 68.8 | — | |
| ToGMethod category=Prompting KG-Augmented LLM, Backbone LLM=GPT-3.5 or others2026.01 | 68.7 | — | |
| FlexKBQAMethod category=Fine-Tuned KG-Augmented LLM2026.01 | 62.8 | — | |
| ToGMethod category=Prompting KG-Augmented LLM, Backbone LLM=Qwen2.5-7B2026.01 | 62.6 | — | |
| KB-BINDERMethod category=Prompting KG-Augmented LLM, Backbone LLM=GPT-3.5 or others2026.01 | 53.2 | — | |
| SCMethod category=LLM-Only2026.01 | 29.6 | — | |
| IO PromptMethod category=LLM-Only2026.01 | 29.4 | — | |
| CoTMethod category=LLM-Only2026.01 | 28.1 | — | |
| ChatGPTType=Pure LLMs2025.12 | — | 25.3 | |
| Davinci-003Type=Pure LLMs2025.12 | — | 30.1 | |
| GPT-4Type=Pure LLMs2025.12 | — | 31.7 | |
| KG-AgentType=LLMs + KG2025.12 | — | 86.1 | |
| PathHDType=LLMs + KG2025.12 | — | 86.7 | |
| StructGPTType=LLMs + KG2025.12 | — | 54.6 |