Knowledge Base Question Answering on T-REx WikiData (test)
83.38Hits@1KG-R1
Evaluation Results
| Method | Links | |
|---|---|---|
| KG-R1Backbone Model=Qwen2.5 3B, Training Dataset=WebQSP2025.09 | 83.38 | |
| KG-R1Backbone Model=Qwen2.5 3B, Training Dataset=CWQ2025.09 | 80.1 | |
| PoGBackbone Model=Qwen 2.5-72B2025.09 | 79.52 | |
| PoGBackbone Model=Qwen 3-235B2025.09 | 78.75 | |
| ReknoSBackbone Model=Qwen 2.5-7B2025.09 | 78.17 | |
| ReknoSBackbone Model=Qwen 2.5-72B2025.09 | 77.11 | |
| ReknoSBackbone Model=Qwen 3-235B2025.09 | 77.05 | |
| ToGBackbone Model=Qwen 3-235B2025.09 | 77 | |
| PoGBackbone Model=Qwen 2.5-7B2025.09 | 75.69 | |
| KG-Hopper w/Qwen-2.5-7BSize=7B, Strategy=KG-Augmented with RL Fine-Tuning2026.03 | 72.14 | |
| DeepSeek-R1-Distill-Llama-70B + KGSize=70B, Strategy=KG-Augmented without Fine-Tuning2026.03 | 72.04 | |
| LLaMA-3.1-8B (SFT) + KGSize=8B, Strategy=KG-Augmented with Supervised Fine-Tuning2026.03 | 70.23 | |
| GPT-4o-mini + KGStrategy=KG-Augmented without Fine-Tuning2026.03 | 69.7 | |
| Qwen-2.5-7B (SFT) + KGSize=7B, Strategy=KG-Augmented with Supervised Fine-Tuning2026.03 | 68.77 | |
| ToGBackbone Model=Qwen 2.5-72B2025.09 | 67.93 | |
| LLaMA-3.1-8B + KGSize=8B, Strategy=KG-Augmented without Fine-Tuning2026.03 | 65.8 | |
| LLaMA-3.3-70B + KGSize=70B, Strategy=KG-Augmented without Fine-Tuning2026.03 | 65.42 | |
| Qwen-2.5-7B + KGSize=7B, Strategy=KG-Augmented without Fine-Tuning2026.03 | 64.21 | |
| ToGBackbone Model=Qwen 2.5-7B2025.09 | 58.55 | |
| GPT-4oStrategy=LLM Prompting Only2026.03 | 44.46 | |
| SCBackbone Model=Qwen 3-235B2025.09 | 38.79 | |
| CoTBackbone Model=Qwen 3-235B2025.09 | 37.72 | |
| RoGBackbone Model=Qwen 3-235B2025.09 | 37.31 | |
| IOBackbone Model=Qwen 3-235B2025.09 | 34.61 | |
| DeepSeek-R1-Distill-Llama-70BSize=70B, Strategy=LLM Prompting Only2026.03 | 34.21 | |
| RoGBackbone Model=Qwen 2.5-72B2025.09 | 32.5 | |
| Qwen-2.5-7BSize=7B, Strategy=LLM Prompting Only2026.03 | 31.15 | |
| GPT-4o-miniStrategy=LLM Prompting Only2026.03 | 26.9 | |
| IOBackbone Model=Qwen 2.5-72B2025.09 | 26.16 | |
| SCBackbone Model=Qwen 2.5-72B2025.09 | 26.01 | |
| CoTBackbone Model=Qwen 2.5-72B2025.09 | 24.48 | |
| LLaMA-3.1-8BSize=8B, Strategy=LLM Prompting Only2026.03 | 23 | |
| IOBackbone Model=Qwen 2.5-7B2025.09 | 22.79 | |
| RoGBackbone Model=Qwen 2.5-7B2025.09 | 22.37 | |
| LLaMA-3.3-70BSize=70B, Strategy=LLM Prompting Only2026.03 | 20.12 | |
| SCBackbone Model=Qwen 2.5-7B2025.09 | 20.01 | |
| CoTBackbone Model=Qwen 2.5-7B2025.09 | 17.38 |