Question Answering on MQuAKE
92EMMACR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MACRModel=Llama3.1-8B2026.06 | 92 | 92.4 | |
| MACRModel=Qwen2.5-7B2026.06 | 86.1 | 87.6 | |
| CK-PLUGModel=Llama3.1-8B2026.06 | 63.4 | 69.1 | |
| InstructRAGICLModel=Llama3.1-8B2026.06 | 59.7 | 64.8 | |
| ICLModel=Qwen2.5-7B2026.06 | 59.1 | 62.8 | |
| CK-PLUGModel=Qwen2.5-7B2026.06 | 58.2 | 64.7 | |
| InstructRAGICLModel=Qwen2.5-7B2026.06 | 57.4 | 63.3 | |
| ICLModel=Llama3.1-8B2026.06 | 57.3 | 61.6 | |
| TruthfulRAGModel=Llama3.1-8B2026.06 | 56.8 | 60.5 | |
| TruthfulRAGModel=Qwen2.5-7B2026.06 | 52.4 | 55.8 | |
| DirectModel=Qwen2.5-7B2026.06 | 25.9 | 32.8 | |
| DirectModel=Llama3.1-8B2026.06 | 20.8 | 25.8 |