Relation Extraction on T-REx WikiData (test)
83.68Hits@1KG-Reasoner with Qwen-2.5-7B
Evaluation results
| Method | Links | |
|---|---|---|
| KG-Reasoner with Qwen-2.5-7BSize=7B, KG Integration=WikiData, Fine-tuning Protocol=KG-Reasoner Fine-Tuning2026.04 | 83.68 | |
| ToG with GPT 4Size=–, KG Integration=WikiData, Fine-tuning Protocol=Search-based2026.04 | 77.1 | |
| ToG with GPT 3.5-TurboSize=–, KG Integration=WikiData, Fine-tuning Protocol=Search-based2026.04 | 76.8 | |
| DeepSeek-R1-Distill-Llama-70B + KGSize=70B, KG Integration=WikiData, Fine-tuning Protocol=None2026.04 | 72.04 | |
| LLaMA-3.1-8B (SFT) + KGSize=8B, KG Integration=WikiData, Fine-tuning Protocol=SFT2026.04 | 70.23 | |
| GPT-4o-mini + KGSize=–, KG Integration=WikiData, Fine-tuning Protocol=None2026.04 | 69.7 | |
| Qwen-2.5-7B (SFT) + KGSize=7B, KG Integration=WikiData, Fine-tuning Protocol=SFT2026.04 | 68.77 | |
| LLaMA-3.1-8B + KGSize=8B, KG Integration=WikiData, Fine-tuning Protocol=None2026.04 | 65.8 | |
| LLaMA-3.3-70B + KGSize=70B, KG Integration=WikiData, Fine-tuning Protocol=None2026.04 | 65.42 | |
| Qwen-2.5-7B + KGSize=7B, KG Integration=WikiData, Fine-tuning Protocol=None2026.04 | 64.21 | |
| GPT-4oSize=–, KG Integration=None, Fine-tuning Protocol=None2026.04 | 44.46 | |
| DeepSeek-R1-Distill-Llama-70BSize=70B, KG Integration=None, Fine-tuning Protocol=None2026.04 | 34.21 | |
| Qwen-2.5-7BSize=7B, KG Integration=None, Fine-tuning Protocol=None2026.04 | 31.15 | |
| GPT-4o-miniSize=–, KG Integration=None, Fine-tuning Protocol=None2026.04 | 26.9 | |
| LLaMA-3.1-8BSize=8B, KG Integration=None, Fine-tuning Protocol=None2026.04 | 23 | |
| LLaMA-3.3-70BSize=70B, KG Integration=None, Fine-tuning Protocol=None2026.04 | 20.12 |