Multi-hop Question Answering on MuSiQue (EM, F1, Calls)
70.2EMReaLM-Retrieve
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ReaLM-RetrieveBackbone=DeepSeek-R1-671B2026.04 | 70.2 | 77.8 | 1.9 | |
| Search-R1Backbone=DeepSeek-R1-671B2026.04 | 65.8 | 73.4 | 2.6 | |
| IRCoTBackbone=DeepSeek-R1-671B2026.04 | 64.2 | 71.8 | 3.6 | |
| ReaLM-RetrieveBackbone=DeepSeek-R1-Distill-Qwen-32B2026.04 | 63.5 | 71.2 | 1.8 | |
| Search-R1Backbone=DeepSeek-R1-Distill-Qwen-32B2026.04 | 59.1 | — | 2.4 | |
| Single RAGBackbone=DeepSeek-R1-671B2026.04 | 58.7 | 66.2 | 1 | |
| IRCoTBackbone=DeepSeek-R1-Distill-Qwen-32B2026.04 | 58.3 | 65.4 | 3.4 | |
| FLAREBackbone=DeepSeek-R1-Distill-Qwen-32B, Note=Uses token probabilities2026.04 | 55.1 | 62.3 | 2.8 | |
| Self-RAGBackbone=DeepSeek-R1-Distill-Qwen-32B, Model Type=fine-tuned2026.04 | 54.8 | 61.9 | 2.1 | |
| Single RAGBackbone=DeepSeek-R1-Distill-Qwen-32B2026.04 | 52.6 | 59.4 | 1 | |
| No RetrievalBackbone=DeepSeek-R1-671B2026.04 | 48.3 | 55.9 | 0 | |
| No RetrievalBackbone=DeepSeek-R1-Distill-Qwen-32B2026.04 | 41.2 | 48.7 | 0 |