Relation completion on MALT
62.7EMRC-RAG
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RC-RAGContext Length=Top-20, Model=Mistral-7B-Instruct-v0.32026.04 | 62.7 | 65.1 | |
| RC-RAGContext Length=Top-20, Model=Mixtral-8x7B-Instruct-v0.12026.04 | 62.2 | 64.8 | |
| RC-RAGContext Length=Top-10, Model=Mixtral-8x7B-Instruct-v0.12026.04 | 61 | 63.3 | |
| RC-RAGContext Length=Top-10, Model=Mistral-7B-Instruct-v0.32026.04 | 60.6 | 63.2 | |
| RC-RAGContext Length=Top-20, Model=Llama-2-13B-chat-hf2026.04 | 60.5 | 62.9 | |
| RC-RAGContext Length=Top-20, Model=Meta-Llama-3.1-8B-Instruct2026.04 | 60.3 | 62.6 | |
| RC-RAGContext Length=Top-10, Model=Meta-Llama-3.1-8B-Instruct2026.04 | 59.3 | 61.3 | |
| RC-RAGContext Length=Top-20, Model=Llama-2-7B-chat-hf2026.04 | 59.3 | 61.5 | |
| RC-RAGContext Length=Top-10, Model=Llama-2-13B-chat-hf2026.04 | 58.9 | 61.1 | |
| RC-RAGContext Length=Top-10, Model=Llama-2-7B-chat-hf2026.04 | 58.6 | 60.9 | |
| SELF-RAGContext Length=Top-102026.04 | 54.2 | 57.3 | |
| RECOMPContext Length=Top-102026.04 | 37.1 | 39 | |
| Mixtral-8x7B-Instruct-v0.1Context Length=No-context2026.04 | 34.7 | 38.4 | |
| Meta-Llama-3.1-8B-InstructContext Length=No-context2026.04 | 22.8 | 27.7 | |
| Mistral-7B-Instruct-v0.3Context Length=No-context2026.04 | 16.1 | 20.1 | |
| Llama-2-13B-chat-hfContext Length=No-context2026.04 | 16 | 19.4 | |
| Llama-2-7B-chat-hfContext Length=No-context2026.04 | 13.6 | 17 |