List your company
ResearchFormerly WizWand

Relation Extraction on Zero-Shot RE WikiData (test)

91.43Hits@1KG-Reasoner with Qwen-2.5-7B
4.496427.065749.63572.2043Mar 22, 2026Mar 25, 2026Mar 29, 2026Apr 2, 2026Apr 6, 2026Apr 10, 2026Apr 14, 2026
Updated 6mo ago

Evaluation results

MethodLinks
KG-Reasoner with Qwen-2.5-7BSize=7B, KG Integration=WikiData, Fine-tuning Protocol=KG-Reasoner Fine-Tuning2026.0491.43
ToG-2.0 (ICL)(GPT-3.5-turbo)Size=-, KG Integration=WikiData, Fine-tuning Protocol=ICL2026.0491
ToG with GPT 4Size=–, KG Integration=WikiData, Fine-tuning Protocol=Search-based2026.0488.3
ToG with GPT 3.5-TurboSize=–, KG Integration=WikiData, Fine-tuning Protocol=Search-based2026.0488
LLaMA-3.3-70B + KGSize=70B, Strategy=KG-Augmented without Fine-Tuning2026.0380.42
LLaMA-3.3-70B + KGSize=70B, KG Integration=WikiData, Fine-tuning Protocol=None2026.0480.42
KG-Hopper w/Qwen-2.5-7BSize=7B, Strategy=KG-Augmented with RL Fine-Tuning2026.0378.64
DeepSeek-R1-Distill-Llama-70B + KGSize=70B, Strategy=KG-Augmented without Fine-Tuning2026.0378.04
DeepSeek-R1-Distill-Llama-70B + KGSize=70B, KG Integration=WikiData, Fine-tuning Protocol=None2026.0478.04
GPT-4o-mini + KGStrategy=KG-Augmented without Fine-Tuning2026.0375.12
GPT-4o-mini + KGSize=–, KG Integration=WikiData, Fine-tuning Protocol=None2026.0475.12
Qwen-2.5-7B (SFT) + KGSize=7B, Strategy=KG-Augmented with Supervised Fine-Tuning2026.0371.46
Qwen-2.5-7B (SFT) + KGSize=7B, KG Integration=WikiData, Fine-tuning Protocol=SFT2026.0471.46
Qwen-2.5-7B + KGSize=7B, Strategy=KG-Augmented without Fine-Tuning2026.0370.32
Qwen-2.5-7B + KGSize=7B, KG Integration=WikiData, Fine-tuning Protocol=None2026.0470.32
LLaMA-3.1-8B + KGSize=8B, Strategy=KG-Augmented without Fine-Tuning2026.0368.66
LLaMA-3.1-8B + KGSize=8B, KG Integration=WikiData, Fine-tuning Protocol=None2026.0468.66
LLaMA-3.1-8B (SFT) + KGSize=8B, Strategy=KG-Augmented with Supervised Fine-Tuning2026.0364.08
LLaMA-3.1-8B (SFT) + KGSize=8B, KG Integration=WikiData, Fine-tuning Protocol=SFT2026.0464.08
GPT-4oStrategy=LLM Prompting Only2026.0348.2
GPT-4oSize=–, KG Integration=None, Fine-tuning Protocol=None2026.0448.2
DeepSeek-R1-Distill-Llama-70BSize=70B, Strategy=LLM Prompting Only2026.0322.27
DeepSeek-R1-Distill-Llama-70BSize=70B, KG Integration=None, Fine-tuning Protocol=None2026.0422.27
GPT-4o-miniStrategy=LLM Prompting Only2026.0318.85
GPT-4o-miniSize=–, KG Integration=None, Fine-tuning Protocol=None2026.0418.85
LLaMA-3.3-70BSize=70B, Strategy=LLM Prompting Only2026.0318.55
LLaMA-3.3-70BSize=70B, KG Integration=None, Fine-tuning Protocol=None2026.0418.55
LLaMA-3.1-8BSize=8B, Strategy=LLM Prompting Only2026.0312.54
LLaMA-3.1-8BSize=8B, KG Integration=None, Fine-tuning Protocol=None2026.0412.54
Qwen-2.5-7BSize=7B, Strategy=LLM Prompting Only2026.037.84
Qwen-2.5-7BSize=7B, KG Integration=None, Fine-tuning Protocol=None2026.047.84