Knowledge Base Question Answering on WebQSP Freebase (test)
89.9Hits@1RPO-RAG
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| RPO-RAGType=KG + LLM, Backbone=Llama3.1-8B2026.01 | 89.9 | 81.3 | — | — | |
| RPO-RAGType=KG + LLM, Backbone=Llama2-7B2026.01 | 88.3 | 77.8 | — | — | |
| RPO-RAGType=KG + LLM, Backbone=Llama3.2-3B2026.01 | 87.3 | 76.4 | — | — | |
| GCRType=KG + LLM, Backbone=Llama3.1-8B, Reproduced=true2026.01 | 87.2 | 69.1 | — | — | |
| SubgraphRAGType=KG + LLM, Backbone=Llama3.1-8B2026.01 | 86.6 | 70.6 | — | — | |
| ChatKBQAOracle entity linking=true2023.10 | 86.4 | 83.5 | 77.8 | — | |
| RoGType=KG + LLM, Backbone=Llama2-7B2026.01 | 85.7 | 70.8 | — | — | |
| GNN-RAGType=KG + LLM, Backbone=Llama2-7B2026.01 | 85.7 | 71.3 | — | — | |
| GNN-RAGType=KG + LLM, Backbone=Llama3.1-8B, Reproduced=true2026.01 | 85.6 | 70.3 | — | — | |
| GPT-4o-mini + KGStrategy=KG-Augmented without Fine-Tuning2026.03 | 84.4 | — | — | — | |
| ChatKBQA2023.10 | 83.2 | 79.8 | 73.8 | — | |
| KG-Hopper w/Qwen-2.5-7BSize=7B, Strategy=KG-Augmented with RL Fine-Tuning2026.03 | 83.2 | — | — | — | |
| ToGOracle entity linking=true2023.10 | 82.6 | — | — | — | |
| RPO-RAGType=KG + LLM, Backbone=Llama3.2-1B2026.01 | 82.3 | 69.8 | — | — | |
| DecAF2023.10 | 82.1 | 78.8 | — | — | |
| KG-CoT w/GPT 3.5-TurboStrategy=KG-Augmented without Fine-Tuning2026.03 | 82.1 | — | — | — | |
| LLaMA-3.3-70B + KGSize=70B, Strategy=KG-Augmented without Fine-Tuning2026.03 | 81.9 | — | — | — | |
| DeepSeek-R1-Distill-Llama-70B + KGSize=70B, Strategy=KG-Augmented without Fine-Tuning2026.03 | 81.34 | — | — | — | |
| SKP2023.10 | 79.6 | — | — | — | |
| DeepSeek-R1-Distill-Llama-70BSize=70B, Strategy=LLM Prompting Only2026.03 | 77.43 | — | — | — | |
| UniKGQAOracle entity linking=true2023.10 | 77.2 | 72.2 | — | — | |
| UniKGQAType=GNN-based2026.01 | 77.2 | 72.2 | — | — | |
| HGNetOracle entity linking=true2023.10 | 76.9 | 76.6 | 70.7 | — | |
| EmQLOracle entity linking=true2023.10 | 75.5 | — | — | — | |
| TIARAOracle entity linking=true2023.10 | 75.2 | 78.9 | — | — | |
| Qwen-2.5-7B (SFT) + KGSize=7B, Strategy=KG-Augmented with Supervised Fine-Tuning2026.03 | 74.8 | — | — | — | |
| ReTraCkOracle entity linking=true2023.10 | 74.6 | 74.7 | — | — | |
| Program TransferOracle entity linking=true2023.10 | 74.6 | 76.5 | — | — | |
| KG-CoT w/LLaMA-13BSize=13B, Strategy=KG-Augmented with Supervised Fine-Tuning2026.03 | 74.6 | — | — | — | |
| NSM+hOracle entity linking=true2023.10 | 74.3 | 67.4 | — | — | |
| BeamQAOracle entity linking=true2023.10 | 73.4 | — | — | — | |
| RigelOracle entity linking=true2023.10 | 73.3 | — | — | — | |
| QGG2023.10 | 73 | 74 | — | — | |
| LLaMA-3.1-8B (SFT) + KGSize=8B, Strategy=KG-Augmented with Supervised Fine-Tuning2026.03 | 72.98 | — | — | — | |
| Relation Learning2023.10 | 72.9 | 64.5 | — | — | |
| Qwen-2.5-7B + KGSize=7B, Strategy=KG-Augmented without Fine-Tuning2026.03 | 72.6 | — | — | — | |
| GPT-4oStrategy=LLM Prompting Only2026.03 | 72.55 | — | — | — | |
| KG-CoT w/LLaMA-7BSize=7B, Strategy=KG-Augmented with Supervised Fine-Tuning2026.03 | 72.4 | — | — | — | |
| TextRay2023.10 | 72.2 | 60.3 | — | — | |
| TransferNet2023.10 | 71.4 | — | — | — | |
| LLaMA-3.1-8B + KGSize=8B, Strategy=KG-Augmented without Fine-Tuning2026.03 | 71.32 | — | — | — | |
| LLaMA-3.3-70BSize=70B, Strategy=LLM Prompting Only2026.03 | 71.12 | — | — | — | |
| Subgraph RetrievalOracle entity linking=true2023.10 | 69.5 | 64.1 | — | — | |
| SR + NSMType=GNN-based2026.01 | 68.9 | 64.1 | — | — | |
| NSMType=GNN-based2026.01 | 68.7 | 62.8 | — | — | |
| Topic Units2023.10 | 68.2 | 67.9 | — | — | |
| PullNet2023.10 | 68.1 | — | — | — | |
| GRAFT-Net2023.10 | 67.8 | 62.8 | — | — | |
| GraftNetType=GNN-based2026.01 | 66.7 | 62.4 | — | — | |
| EmbedKGQAOracle entity linking=true2023.10 | 66.6 | — | — | — | |
| GPT-4o-miniStrategy=LLM Prompting Only2026.03 | 65.97 | — | — | — | |
| Llama3.2-3BType=Vanilla LLM2026.01 | 62.5 | 32.2 | — | — | |
| Llama2-7BType=Vanilla LLM2026.01 | 56.4 | 36.5 | — | — | |
| Llama3.1-8BType=Vanilla LLM2026.01 | 55.5 | 34.8 | — | — | |
| Interactive-KBQA w/LLaMA-13BSize=13B, Strategy=KG-Augmented with Supervised Fine-Tuning2026.03 | 54.86 | — | — | — | |
| Llama3.2-1BType=Vanilla LLM2026.01 | 50.2 | 28.9 | — | — | |
| Qwen-2.5-7BSize=7B, Strategy=LLM Prompting Only2026.03 | 46.97 | — | — | — | |
| KV-Mem2023.10 | 46.7 | 34.5 | — | — | |
| LLaMA-3.1-8BSize=8B, Strategy=LLM Prompting Only2026.03 | 45.07 | — | — | — | |
| Interactive-KBQA w/LLaMA-7BSize=7B, Strategy=KG-Augmented with Supervised Fine-Tuning2026.03 | 43.57 | — | — | — | |
| ArcaneQA2023.10 | — | 75.6 | — | — | |
| CBR-KBQA2023.10 | — | 72.8 | 69.9 | — | |
| Chain-of-ThoughtBackbone=GPT-4o2025.10 | — | — | — | 69 | |
| Debate-on-GraphBackbone=GPT-42025.10 | — | — | — | 91 | |
| EffiQABackbone=GPT-42025.10 | — | — | — | 82.9 | |
| FC-KBQA2023.10 | — | 76.9 | — | — | |
| FiDeLiSBackbone=GPT-4-Turbo2025.10 | — | — | — | 84.4 | |
| FiDeLiSBackbone=GPT-4o2025.10 | — | — | — | 81.2 | |
| Generate-on-GraphBackbone=GPT-42025.10 | — | — | — | 84.4 | |
| GMT-KBQA2023.10 | — | 76.6 | 73.1 | — | |
| GRAFT-Net2025.10 | — | — | — | 66.4 | |
| GrailQA RankingOracle entity linking=true2023.10 | — | 70 | — | — | |
| IO PromptBackbone=GPT-4o2025.10 | — | — | — | 68.4 | |
| iQUESTBackbone=GPT-4o2025.10 | — | — | — | 88.9 | |
| KELDaRBackbone=GPT-42025.10 | — | — | — | 84.7 | |
| ORTBackbone=GPT-4o2025.10 | — | — | — | 87.7 | |
| Pangu2023.10 | — | 79.6 | — | — | |
| Plan-on-GraphBackbone=GPT-42025.10 | — | — | — | 87.3 | |
| PullNet2025.10 | — | — | — | 68.1 | |
| ReadiBackbone=GPT-42025.10 | — | — | — | 78.7 | |
| ReKnoSBackbone=GPT-42025.10 | — | — | — | 84.9 | |
| RnG-KBQA2023.10 | — | 75.6 | 71.1 | — | |
| Self-ConsistencyBackbone=GPT-4o2025.10 | — | — | — | 68.2 | |
| SoGBackbone=GPT-4o2025.10 | — | — | — | 91.3 | |
| STAGG2023.10 | — | 71.7 | 63.9 | — | |
| StructGPTOracle entity linking=true2023.10 | — | 72.6 | — | — | |
| SubgraphRAGBackbone=GPT-4o2025.10 | — | — | — | 90.9 | |
| Think-on-GraphBackbone=GPT-42025.10 | — | — | — | 82.6 | |
| Think-on-GraphBackbone=GPT-4o, Reproduced status=reproduced2025.10 | — | — | — | 80.2 | |
| TransferNet2025.10 | — | — | — | 71.4 | |
| UHop2023.10 | — | 68.5 | — | — | |
| Uni-ParserOracle entity linking=true2023.10 | — | 75.8 | 71.4 | — | |
| UnifiedSKG2023.10 | — | 73.9 | — | — | |
| UniK-QA2023.10 | — | 79.1 | — | — | |
| UniKGQA2025.10 | — | — | — | 77.2 |