# Multi-hop Question Answering on Musique in-domain (test) Source: [Multi-hop Question Answering on Musique in-domain (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:34:37.036Z Evaluation of model performance on the in-domain test split of the Musique dataset for Multi-hop Question Answering. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Multi-hop Question Answering | | Dataset (including any stated split) | Musique in-domain (test) | | Metric | Accuracy R | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 14 of 14 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy R](): Higher is better; unit: PERCENT. - [Accuracy L](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy R | Result date | Report paper | | --- | --- | --- | --- | | ReARTeR | 29.6 | Not recorded | 698abbaac97a0b3e3b5ddffe | | DLLM-Searcher | 29 | Not recorded | 698abbaac97a0b3e3b5ddffe | | R1Searcher | 28.2 | Not recorded | 698abbaac97a0b3e3b5ddffe | | Search-R1 | 28 | Not recorded | 698abbaac97a0b3e3b5ddffe | | WebSailor | 22 | Not recorded | 698abbaac97a0b3e3b5ddffe | | Search-o1 | 15.2 | Not recorded | 698abbaac97a0b3e3b5ddffe | | LLaDA | 15.2 | Not recorded | 698abbaac97a0b3e3b5ddffe | | Iter-RetGen | 14.8 | Not recorded | 698abbaac97a0b3e3b5ddffe | | CR-Planner | 12.2 | Not recorded | 698abbaac97a0b3e3b5ddffe | | IRCoT | 11.6 | Not recorded | 698abbaac97a0b3e3b5ddffe | | SuRe | 7.2 | Not recorded | 698abbaac97a0b3e3b5ddffe | | Adaptive-RAG | 7.2 | Not recorded | 698abbaac97a0b3e3b5ddffe | | Selective-Context | 5.8 | Not recorded | 698abbaac97a0b3e3b5ddffe | | Dream | 3.8 | Not recorded | 698abbaac97a0b3e3b5ddffe | ### ReARTeR Accuracy R: 29.6. Result ID: 699607945698665ec43efdc3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Traditional RAG"}. This record does not assert independent reproduction. ### DLLM-Searcher Accuracy R: 29. Result ID: 699607945698665ec43efdca. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Category":"dLLMs Agent","paradigm":"P-ReAct","training":"VRPO","backbone":"SDAR"}. This record does not assert independent reproduction. ### R1Searcher Accuracy R: 28.2. Result ID: 699607945698665ec43efdc7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"ARM-based LLMs Agent","setup":"modified (5.1.3)","search\_mode":"best of local/Google search"}. This record does not assert independent reproduction. ### Search-R1 Accuracy R: 28. Result ID: 699607945698665ec43efdc5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"ARM-based LLMs Agent"}. This record does not assert independent reproduction. ### WebSailor Accuracy R: 22. Result ID: 699607945698665ec43efdc6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"ARM-based LLMs Agent","setup":"modified (5.1.3)","tools":"search only"}. This record does not assert independent reproduction. ### Search-o1 Accuracy R: 15.2. Result ID: 699607945698665ec43efdc4. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Category":"ARM-based LLMs Agent"}. This record does not assert independent reproduction. ### LLaDA Accuracy R: 15.2. Result ID: 699607945698665ec43efdc9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"dLLMs Agent","paradigm":"ReAct","acceleration":"Fast-dLLM"}. This record does not assert independent reproduction. ### Iter-RetGen Accuracy R: 14.8. Result ID: 699607945698665ec43efdc1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Traditional RAG"}. This record does not assert independent reproduction. ### CR-Planner Accuracy R: 12.2. Result ID: 699607945698665ec43efdc2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Traditional RAG"}. This record does not assert independent reproduction. ### IRCoT Accuracy R: 11.6. Result ID: 699607945698665ec43efdc0. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Category":"Traditional RAG"}. This record does not assert independent reproduction. ### SuRe Accuracy R: 7.2. Result ID: 699607945698665ec43efdbd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Traditional RAG"}. This record does not assert independent reproduction. ### Adaptive-RAG Accuracy R: 7.2. Result ID: 699607945698665ec43efdbf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Traditional RAG"}. This record does not assert independent reproduction. ### Selective-Context Accuracy R: 5.8. Result ID: 699607945698665ec43efdbe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Traditional RAG"}. This record does not assert independent reproduction. ### Dream Accuracy R: 3.8. Result ID: 699607945698665ec43efdc8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"dLLMs Agent","paradigm":"ReAct","acceleration":"Fast-dLLM"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.