List your company
ResearchFormerly WizWand

Knowledge Base Question Answering on CWQ Freebase (test)

86Hits@1ChatKBQA
18.50436.02753.5571.073Oct 13, 2023Mar 9, 2024Aug 5, 2024Dec 31, 2024May 29, 2025Oct 24, 2025Mar 22, 2026
Updated 5mo ago

Evaluation results

MethodLinks
ChatKBQAOracle entity linking=true2023.108681.376.8—
ChatKBQA2023.1082.777.873.3—
CBR-KBQA2023.1070.47067.1—
DecAF2023.1070.4———
ToGOracle entity linking=true2023.1069.5———
HGNetOracle entity linking=true2023.1068.968.557.8—
KG-Hopper w/Qwen-2.5-7BSize=7B, Strategy=KG-Augmented with RL Fine-Tuning2026.0361.07———
Program TransferOracle entity linking=true2023.1058.158.7——
GPT-4o-mini + KGStrategy=KG-Augmented without Fine-Tuning2026.0354.35———
DeepSeek-R1-Distill-Llama-70B + KGSize=70B, Strategy=KG-Augmented without Fine-Tuning2026.0352.38———
Qwen-2.5-7B (SFT) + KGSize=7B, Strategy=KG-Augmented with Supervised Fine-Tuning2026.0351.84———
KG-CoT w/GPT 3.5-TurboStrategy=KG-Augmented without Fine-Tuning2026.0351.6———
UniKGQAOracle entity linking=true2023.1051.249.4——
Subgraph RetrievalOracle entity linking=true2023.1050.247.1——
KG-CoT w/LLaMA-13BSize=13B, Strategy=KG-Augmented with Supervised Fine-Tuning2026.0350———
NSM+hOracle entity linking=true2023.1048.844——
RigelOracle entity linking=true2023.1048.7———
TransferNet2023.1048.6———
LLaMA-3.1-8B (SFT) + KGSize=8B, Strategy=KG-Augmented with Supervised Fine-Tuning2026.0347.4———
PullNet2023.1047.2———
KG-CoT w/LLaMA-7BSize=7B, Strategy=KG-Augmented with Supervised Fine-Tuning2026.0346.7———
LLaMA-3.1-8B + KGSize=8B, Strategy=KG-Augmented without Fine-Tuning2026.0345.64———
Qwen-2.5-7B + KGSize=7B, Strategy=KG-Augmented without Fine-Tuning2026.0344.82———
EmbedKGQAOracle entity linking=true2023.1044.7———
QGG2023.1044.140.4——
LLaMA-3.3-70B + KGSize=70B, Strategy=KG-Augmented without Fine-Tuning2026.0344———
Interactive-KBQA w/LLaMA-13BSize=13B, Strategy=KG-Augmented with Supervised Fine-Tuning2026.0342.5———
GPT-4o-miniStrategy=LLM Prompting Only2026.0342.32———
GPT-4oStrategy=LLM Prompting Only2026.0341.77———
TextRay2023.1040.833.9——
Interactive-KBQA w/LLaMA-7BSize=7B, Strategy=KG-Augmented with Supervised Fine-Tuning2026.0339.9———
Topic Units2023.1039.336.5——
LLaMA-3.3-70BSize=70B, Strategy=LLM Prompting Only2026.0337.2———
GRAFT-Net2023.1036.832.7——
LLaMA-3.1-8BSize=8B, Strategy=LLM Prompting Only2026.0332.33———
DeepSeek-R1-Distill-Llama-70BSize=70B, Strategy=LLM Prompting Only2026.0331.92———
Qwen-2.5-7BSize=7B, Strategy=LLM Prompting Only2026.0331.25———
KV-Mem2023.1021.115.7——
Chain-of-ThoughtBackbone=GPT-4o2025.10———52.4
Debate-on-GraphBackbone=GPT-42025.10———56
EffiQABackbone=GPT-42025.10———69.5
FC-KBQA2023.10—56.4——
FiDeLiSBackbone=GPT-4-Turbo2025.10———71.5
FiDeLiSBackbone=GPT-4o2025.10———65.3
Generate-on-GraphBackbone=GPT-42025.10———75.2
GMT-KBQA2023.10—7772.2—
GRAFT-Net2025.10———32.8
IO PromptBackbone=GPT-4o2025.10———51.7
iQUESTBackbone=GPT-4o2025.10———73.9
KELDaRBackbone=GPT-42025.10———63
ORTBackbone=GPT-4o2025.10———65.4
Plan-on-GraphBackbone=GPT-42025.10———75
PullNet2025.10———47.2
ReadiBackbone=GPT-42025.10———67
ReKnoSBackbone=GPT-42025.10———68.2
Self-ConsistencyBackbone=GPT-4o2025.10———53.8
SoGBackbone=GPT-4o2025.10———75.1
SubgraphRAGBackbone=GPT-4o2025.10———67.5
Think-on-GraphBackbone=GPT-42025.10———69.5
Think-on-GraphBackbone=GPT-4o, Reproduced status=reproduced2025.10———48.9
TransferNet2025.10———48.6
UHop2023.10—29.8——
UnifiedSKG2023.10—68.8——
UniKGQA2025.10———51.2