Relation Completion on Wikidata5M
65.5Exact Match (EM)RC-RAG
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RC-RAGContext Length=Top-20, Model=Mistral-7B-Instruct-v0.32026.04 | 65.5 | 69.1 | |
| RC-RAGContext Length=Top-20, Model=Mixtral-8x7B-Instruct-v0.12026.04 | 65.5 | 68.6 | |
| RC-RAGContext Length=Top-10, Model=Mixtral-8x7B-Instruct-v0.12026.04 | 64.5 | 68.7 | |
| RC-RAGContext Length=Top-10, Model=Mistral-7B-Instruct-v0.32026.04 | 63.8 | 67.5 | |
| RC-RAGContext Length=Top-20, Model=Llama-2-13B-chat-hf2026.04 | 62.8 | 65.7 | |
| RC-RAGContext Length=Top-20, Model=Meta-Llama-3.1-8B-Instruct2026.04 | 62 | 65.3 | |
| RC-RAGContext Length=Top-10, Model=Llama-2-13B-chat-hf2026.04 | 61.7 | 65 | |
| RC-RAGContext Length=Top-10, Model=Meta-Llama-3.1-8B-Instruct2026.04 | 61.1 | 64.6 | |
| RC-RAGContext Length=Top-20, Model=Llama-2-7B-chat-hf2026.04 | 60.8 | 64 | |
| RC-RAGContext Length=Top-10, Model=Llama-2-7B-chat-hf2026.04 | 59.1 | 62.4 | |
| SELF-RAGContext Length=Top-102026.04 | 52.1 | 55.3 | |
| RECOMPContext Length=Top-102026.04 | 47.5 | 50.9 | |
| Mixtral-8x7B-Instruct-v0.1Context Length=No-context2026.04 | 37.3 | 40.7 | |
| Meta-Llama-3.1-8B-InstructContext Length=No-context2026.04 | 30 | 32.6 | |
| Mistral-7B-Instruct-v0.3Context Length=No-context2026.04 | 25.7 | 27.5 | |
| Llama-2-13B-chat-hfContext Length=No-context2026.04 | 21.9 | 23.7 | |
| Llama-2-7B-chat-hfContext Length=No-context2026.04 | 21 | 23.4 |