List your company
ResearchFormerly WizWand

Knowledge Base Question Answering on Creak WikiData (test)

91.82Hits@1KG-Hopper w/Qwen-2.5-7B
72.517677.528882.5487.5512Mar 22, 2026
Updated 7mo ago

Evaluation results

MethodLinks
KG-Hopper w/Qwen-2.5-7BSize=7B, Strategy=KG-Augmented with RL Fine-Tuning2026.0391.82
DeepSeek-R1-Distill-Llama-70B + KGSize=70B, Strategy=KG-Augmented without Fine-Tuning2026.0391.2
GPT-4oStrategy=LLM Prompting Only2026.0390.7
GPT-4o-mini + KGStrategy=KG-Augmented without Fine-Tuning2026.0390.2
LLaMA-3.3-70B + KGSize=70B, Strategy=KG-Augmented without Fine-Tuning2026.0387.04
LLaMA-3.1-8B (SFT) + KGSize=8B, Strategy=KG-Augmented with Supervised Fine-Tuning2026.0384.47
LLaMA-3.3-70BSize=70B, Strategy=LLM Prompting Only2026.0383.72
GPT-4o-miniStrategy=LLM Prompting Only2026.0383.72
Qwen-2.5-7B (SFT) + KGSize=7B, Strategy=KG-Augmented with Supervised Fine-Tuning2026.0383.43
LLaMA-3.1-8B + KGSize=8B, Strategy=KG-Augmented without Fine-Tuning2026.0380.5
DeepSeek-R1-Distill-Llama-70BSize=70B, Strategy=LLM Prompting Only2026.0379.1
Qwen-2.5-7B + KGSize=7B, Strategy=KG-Augmented without Fine-Tuning2026.0379.04
LLaMA-3.1-8BSize=8B, Strategy=LLM Prompting Only2026.0375.8
Qwen-2.5-7BSize=7B, Strategy=LLM Prompting Only2026.0373.26