List your company
ResearchFormerly WizWand

Knowledge Base Question Answering on QALD en Freebase 10 (test)

74.28Hits@1KG-Hopper w/Qwen-2.5-7B
38.888848.076957.26566.4531Mar 22, 2026
Updated 7mo ago

Evaluation results

MethodLinks
KG-Hopper w/Qwen-2.5-7BSize=7B, Strategy=KG-Augmented with RL Fine-Tuning2026.0374.28
GPT-4o-mini + KGStrategy=KG-Augmented without Fine-Tuning2026.0372.86
LLaMA-3.3-70B + KGSize=70B, Strategy=KG-Augmented without Fine-Tuning2026.0371.78
DeepSeek-R1-Distill-Llama-70B + KGSize=70B, Strategy=KG-Augmented without Fine-Tuning2026.0366.1
Qwen-2.5-7B (SFT) + KGSize=7B, Strategy=KG-Augmented with Supervised Fine-Tuning2026.0365.18
LLaMA-3.1-8B (SFT) + KGSize=8B, Strategy=KG-Augmented with Supervised Fine-Tuning2026.0359.63
Qwen-2.5-7B + KGSize=7B, Strategy=KG-Augmented without Fine-Tuning2026.0356.54
GPT-4oStrategy=LLM Prompting Only2026.0356.2
LLaMA-3.3-70BSize=70B, Strategy=LLM Prompting Only2026.0356
LLaMA-3.1-8B + KGSize=8B, Strategy=KG-Augmented without Fine-Tuning2026.0355.73
GPT-4o-miniStrategy=LLM Prompting Only2026.0351.98
DeepSeek-R1-Distill-Llama-70BSize=70B, Strategy=LLM Prompting Only2026.0343.1
Qwen-2.5-7BSize=7B, Strategy=LLM Prompting Only2026.0341.88
LLaMA-3.1-8BSize=8B, Strategy=LLM Prompting Only2026.0340.25