Multi-hop Question Answering on MuSiQue (EM, LJ)
24.12EMM2R
Evaluation results
| Method | Links | ||
|---|---|---|---|
| M2RBackbone=Qwen2.5-7B-Instruct2026.04 | 24.12 | 35.44 | |
| ReSearchBackbone=Qwen2.5-7B-Instruct2026.04 | 22.3 | 33.43 | |
| M2RBackbone=Qwen2.5-3B-Instruct2026.04 | 20.87 | 32.97 | |
| SUREBackbone=Qwen2.5-7B-Instruct2026.04 | 20.87 | 32.24 | |
| ReSearchBackbone=Qwen2.5-3B-Instruct2026.04 | 19.4 | 31.56 | |
| SUREBackbone=Qwen2.5-3B-Instruct2026.04 | 17.24 | 27.61 | |
| COFTBackbone=Qwen2.5-7B-Instruct2026.04 | 17.12 | 26.28 | |
| COFTBackbone=Qwen2.5-3B-Instruct2026.04 | 13.49 | 20.11 | |
| Iter-RetGenBackbone=Qwen2.5-7B-Instruct2026.04 | 8.69 | 16.14 | |
| IRCoTBackbone=Qwen2.5-7B-Instruct2026.04 | 6.99 | 14.19 | |
| Iter-RetGenBackbone=Qwen2.5-3B-Instruct2026.04 | 6.91 | 13.43 | |
| Naive RAGBackbone=Qwen2.5-7B-Instruct2026.04 | 6.21 | 12.78 | |
| IRCoTBackbone=Qwen2.5-3B-Instruct2026.04 | 4.39 | 10.83 | |
| Naive RAGBackbone=Qwen2.5-3B-Instruct2026.04 | 4.14 | 10.32 | |
| Naive GenerationBackbone=Qwen2.5-7B-Instruct2026.04 | 3.76 | 10.38 | |
| Naive GenerationBackbone=Qwen2.5-3B-Instruct2026.04 | 2.62 | 6.08 |