# Multi-hop Question Answering on MuSiQue (EM, F1, Acc)

Source: [Multi-hop Question Answering on MuSiQue (EM, F1, Acc)](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-musique-em-f1-acc>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-17T10:53:36.092Z

Evaluation of model performance on the MuSiQue dataset for Multi-hop Question Answering, focusing on Exact Match (EM), F1 score, and overall Accuracy.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Multi-hop Question Answering |
| Dataset (including any stated split) | MuSiQue |
| Metric | F1 |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 38 of 38 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [F1](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-musique-em-f1-acc.md?metric=F1>): Higher is better; unit: PERCENT.

- [EM](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-musique-em-f1-acc.md?metric=EM>): Higher is better; unit: PERCENT.

- [Acc](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-musique-em-f1-acc.md?metric=Acc>): Higher is better; unit: PERCENT.

- [Avg Score](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-musique-em-f1-acc.md?metric=Avg%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | F1 | Result date | Report paper |
| --- | --- | --- | --- |
| C2RAG | 46.1 | Not recorded | 69b8e0260636e5bf4afbec79 |
| NeuroPath | 43.5 | Not recorded | 69b8e0260636e5bf4afbec79 |
| Iter-RetGen | 43.3 | Not recorded | 69b8e0260636e5bf4afbec79 |
| IRCoT | 43.1 | Not recorded | 69b8e0260636e5bf4afbec79 |
| CompactRAG GPT-4-Reading | 42.34 | Not recorded | 698575cbc97a0b3e3b5d5df5 |
| HippoRAG2 | 42.2 | Not recorded | 69b8e0260636e5bf4afbec79 |
| HippoRAG | 41.5 | Not recorded | 69b8e0260636e5bf4afbec79 |
| GFM-RAG | 40.9 | Not recorded | 69b8e0260636e5bf4afbec79 |
| CompactRAG LLaMA-3.1-8b-Reading | 37.63 | Not recorded | 698575cbc97a0b3e3b5d5df5 |
| SPARC-RAG | 36.6 | Not recorded | 69818123a8b01e76cc8e22cd |
| SubgraphRAG | 35.7 | Not recorded | 69b8e0260636e5bf4afbec79 |
| SPARC-RAG + DPO | 33.9 | Not recorded | 69818123a8b01e76cc8e22cd |
| G-retriever | 33.9 | Not recorded | 69b8e0260636e5bf4afbec79 |
| Iter-RetGen | 32.42 | Not recorded | 698575cbc97a0b3e3b5d5df5 |
| SPARC-RAG + DPO | 32.4 | Not recorded | 69818123a8b01e76cc8e22cd |
| DeepNote | 30.9 | Not recorded | 69818123a8b01e76cc8e22cd |
| BM25 | 29.9 | Not recorded | 69b8e0260636e5bf4afbec79 |
| Iter-RetGen | 29.4 | Not recorded | 69818123a8b01e76cc8e22cd |
| IRCoT | 29.08 | Not recorded | 698575cbc97a0b3e3b5d5df5 |
| Self-Ask | 28.34 | Not recorded | 698575cbc97a0b3e3b5d5df5 |
| SPARC-RAG | 24.3 | Not recorded | 69818123a8b01e76cc8e22cd |
| PathRAG | 22.1 | Not recorded | 69b8e0260636e5bf4afbec79 |
| Iter-RetGen | 21.4 | Not recorded | 69818123a8b01e76cc8e22cd |
| Self-RAG | 20.7 | Not recorded | 69818123a8b01e76cc8e22cd |
| DeepNote | 19.8 | Not recorded | 69818123a8b01e76cc8e22cd |
| Speculative-RAG | 19.1 | Not recorded | 69818123a8b01e76cc8e22cd |
| Self-RAG | 15.8 | Not recorded | 69818123a8b01e76cc8e22cd |
| Speculative-RAG | 15.7 | Not recorded | 69818123a8b01e76cc8e22cd |
| Vanilla RAG | 13.8 | Not recorded | 69818123a8b01e76cc8e22cd |
| Parallel (Naive) | 13.8 | Not recorded | 69818123a8b01e76cc8e22cd |
| IRCoT | 12.4 | Not recorded | 69818123a8b01e76cc8e22cd |
| Sequential (Naive) | 12.1 | Not recorded | 69818123a8b01e76cc8e22cd |
| Vanilla-RAG | 11.36 | Not recorded | 698575cbc97a0b3e3b5d5df5 |
| Parallel (Naive) | 10.9 | Not recorded | 69818123a8b01e76cc8e22cd |
| Vanilla RAG | 10.6 | Not recorded | 69818123a8b01e76cc8e22cd |
| Sequential (Naive) | 10.3 | Not recorded | 69818123a8b01e76cc8e22cd |
| IRCoT | 10.1 | Not recorded | 69818123a8b01e76cc8e22cd |
| LightRAG | 9.7 | Not recorded | 69b8e0260636e5bf4afbec79 |

### C2RAG

F1: 46.1. Result ID: 69b9329b47f34ce924a2af62.

[Reporting paper](<https://www.sota2.com/research/paper/69b8e0260636e5bf4afbec79.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b8e0260636e5bf4afbec79.md>)

Recorded evaluation configuration: {"LLM":"GPT-4o-mini"}. This record does not assert independent reproduction.

### NeuroPath

F1: 43.5. Result ID: 69b9329b47f34ce924a2af61.

[Reporting paper](<https://www.sota2.com/research/paper/69b8e0260636e5bf4afbec79.md>)

[Method origin paper](<https://www.sota2.com/research/paper/691d4f09d6b0dd334292d6e6.md>)

Recorded evaluation configuration: {"LLM":"GPT-4o-mini"}. This record does not assert independent reproduction.

### Iter-RetGen

F1: 43.3. Result ID: 69b9329b47f34ce924a2af59.

[Reporting paper](<https://www.sota2.com/research/paper/69b8e0260636e5bf4afbec79.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f21e209131cea4e48a.md>)

Recorded evaluation configuration: {"LLM":"GPT-4o-mini"}. This record does not assert independent reproduction.

### IRCoT

F1: 43.1. Result ID: 69b9329b47f34ce924a2af58.

[Reporting paper](<https://www.sota2.com/research/paper/69b8e0260636e5bf4afbec79.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fd81e209131cea4791d.md>)

[Implementation](<https://github.com/stonybrooknlp/ircot>)

Recorded evaluation configuration: {"LLM":"GPT-4o-mini"}. This record does not assert independent reproduction.

### CompactRAG GPT-4-Reading

F1: 42.34. Result ID: 69a1752b35dfcabb00e7280d.

[Reporting paper](<https://www.sota2.com/research/paper/698575cbc97a0b3e3b5d5df5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/698575cbc97a0b3e3b5d5df5.md>)

Recorded evaluation configuration: {"Token / Sample":"1.9K"}. This record does not assert independent reproduction.

### HippoRAG2

F1: 42.2. Result ID: 69b9329b47f34ce924a2af5c.

[Reporting paper](<https://www.sota2.com/research/paper/69b8e0260636e5bf4afbec79.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79821e209131cea7de8a.md>)

Recorded evaluation configuration: {"LLM":"GPT-4o-mini"}. This record does not assert independent reproduction.

### HippoRAG

F1: 41.5. Result ID: 69b9329b47f34ce924a2af5b.

[Reporting paper](<https://www.sota2.com/research/paper/69b8e0260636e5bf4afbec79.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76981e209131cea6dff9.md>)

Recorded evaluation configuration: {"LLM":"GPT-4o-mini"}. This record does not assert independent reproduction.

### GFM-RAG

F1: 40.9. Result ID: 69b9329b47f34ce924a2af5e.

[Reporting paper](<https://www.sota2.com/research/paper/69b8e0260636e5bf4afbec79.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c3d1e209131cea8d1bf.md>)

Recorded evaluation configuration: {"LLM":"GPT-4o-mini"}. This record does not assert independent reproduction.

### CompactRAG LLaMA-3.1-8b-Reading

F1: 37.63. Result ID: 69a1752b35dfcabb00e7280c.

[Reporting paper](<https://www.sota2.com/research/paper/698575cbc97a0b3e3b5d5df5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/698575cbc97a0b3e3b5d5df5.md>)

Recorded evaluation configuration: {"Token / Sample":"1.9K"}. This record does not assert independent reproduction.

### SPARC-RAG

F1: 36.6. Result ID: 6998ac165698665ec40ecf4b.

[Reporting paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B"}. This record does not assert independent reproduction.

### SubgraphRAG

F1: 35.7. Result ID: 69b9329b47f34ce924a2af5f.

[Reporting paper](<https://www.sota2.com/research/paper/69b8e0260636e5bf4afbec79.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77401e209131cea71faf.md>)

Recorded evaluation configuration: {"LLM":"GPT-4o-mini"}. This record does not assert independent reproduction.

### SPARC-RAG + DPO

F1: 33.9. Result ID: 6998ac165698665ec40ecf4c.

[Reporting paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B","fine-tuned":true}. This record does not assert independent reproduction.

### G-retriever

F1: 33.9. Result ID: 69b9329b47f34ce924a2af5d.

[Reporting paper](<https://www.sota2.com/research/paper/69b8e0260636e5bf4afbec79.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73541e209131cea5bdef.md>)

[Implementation](<https://github.com/XiaoxinHe/G-Retriever>)

Recorded evaluation configuration: {"LLM":"GPT-4o-mini"}. This record does not assert independent reproduction.

### Iter-RetGen

F1: 32.42. Result ID: 69a1752b35dfcabb00e7280b.

[Reporting paper](<https://www.sota2.com/research/paper/698575cbc97a0b3e3b5d5df5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f21e209131cea4e48a.md>)

Recorded evaluation configuration: {"Token / Sample":"4.7K"}. This record does not assert independent reproduction.

### SPARC-RAG + DPO

F1: 32.4. Result ID: 6998ac165698665ec40ecf43.

[Reporting paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct","fine-tuned":true}. This record does not assert independent reproduction.

### DeepNote

F1: 30.9. Result ID: 6998ac165698665ec40ecf4a.

[Reporting paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77e01e209131cea75bac.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B"}. This record does not assert independent reproduction.

### BM25

F1: 29.9. Result ID: 69b9329b47f34ce924a2af57.

[Reporting paper](<https://www.sota2.com/research/paper/69b8e0260636e5bf4afbec79.md>)

Recorded evaluation configuration: {"LLM":"GPT-4o-mini"}. This record does not assert independent reproduction.

### Iter-RetGen

F1: 29.4. Result ID: 6998ac165698665ec40ecf47.

[Reporting paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f21e209131cea4e48a.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B"}. This record does not assert independent reproduction.

### IRCoT

F1: 29.08. Result ID: 69a1752b35dfcabb00e7280a.

[Reporting paper](<https://www.sota2.com/research/paper/698575cbc97a0b3e3b5d5df5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fd81e209131cea4791d.md>)

[Implementation](<https://github.com/stonybrooknlp/ircot>)

Recorded evaluation configuration: {"Token / Sample":"10.2K"}. This record does not assert independent reproduction.

### Self-Ask

F1: 28.34. Result ID: 69a1752b35dfcabb00e72809.

[Reporting paper](<https://www.sota2.com/research/paper/698575cbc97a0b3e3b5d5df5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70ef1e209131cea4e227.md>)

[Implementation](<https://github.com/ofirpress/self-ask>)

Recorded evaluation configuration: {"Token / Sample":"6.9K"}. This record does not assert independent reproduction.

### SPARC-RAG

F1: 24.3. Result ID: 6998ac165698665ec40ecf42.

[Reporting paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction.

### PathRAG

F1: 22.1. Result ID: 69b9329b47f34ce924a2af60.

[Reporting paper](<https://www.sota2.com/research/paper/69b8e0260636e5bf4afbec79.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa770b1e209131cea70b8f.md>)

Recorded evaluation configuration: {"LLM":"GPT-4o-mini"}. This record does not assert independent reproduction.

### Iter-RetGen

F1: 21.4. Result ID: 6998ac165698665ec40ecf3e.

[Reporting paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f21e209131cea4e48a.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction.

### Self-RAG

F1: 20.7. Result ID: 6998ac165698665ec40ecf49.

[Reporting paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e51e209131cea4dc1c.md>)

[Implementation](<https://selfrag.github.io/>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B"}. This record does not assert independent reproduction.

### DeepNote

F1: 19.8. Result ID: 6998ac165698665ec40ecf41.

[Reporting paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77e01e209131cea75bac.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction.

### Speculative-RAG

F1: 19.1. Result ID: 6998ac165698665ec40ecf48.

[Reporting paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77261e209131cea71624.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B"}. This record does not assert independent reproduction.

### Self-RAG

F1: 15.8. Result ID: 6998ac165698665ec40ecf40.

[Reporting paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e51e209131cea4dc1c.md>)

[Implementation](<https://selfrag.github.io/>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction.

### Speculative-RAG

F1: 15.7. Result ID: 6998ac165698665ec40ecf3f.

[Reporting paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77261e209131cea71624.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction.

### Vanilla RAG

F1: 13.8. Result ID: 6998ac165698665ec40ecf39.

[Reporting paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction.

### Parallel (Naive)

F1: 13.8. Result ID: 6998ac165698665ec40ecf3b.

[Reporting paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction.

### IRCoT

F1: 12.4. Result ID: 6998ac165698665ec40ecf3d.

[Reporting paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fd81e209131cea4791d.md>)

[Implementation](<https://github.com/stonybrooknlp/ircot>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction.

### Sequential (Naive)

F1: 12.1. Result ID: 6998ac165698665ec40ecf3c.

[Reporting paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction.

### Vanilla-RAG

F1: 11.36. Result ID: 69a1752b35dfcabb00e72808.

[Reporting paper](<https://www.sota2.com/research/paper/698575cbc97a0b3e3b5d5df5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69b91e209131cea23c26.md>)

[Implementation](<https://github.com/huggingface/transformers/blob/master/examples/rag/>)

Recorded evaluation configuration: {"Token / Sample":"2.7K"}. This record does not assert independent reproduction.

### Parallel (Naive)

F1: 10.9. Result ID: 6998ac165698665ec40ecf44.

[Reporting paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B"}. This record does not assert independent reproduction.

### Vanilla RAG

F1: 10.6. Result ID: 6998ac165698665ec40ecf3a.

[Reporting paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B"}. This record does not assert independent reproduction.

### Sequential (Naive)

F1: 10.3. Result ID: 6998ac165698665ec40ecf45.

[Reporting paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B"}. This record does not assert independent reproduction.

### IRCoT

F1: 10.1. Result ID: 6998ac165698665ec40ecf46.

[Reporting paper](<https://www.sota2.com/research/paper/69818123a8b01e76cc8e22cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fd81e209131cea4791d.md>)

[Implementation](<https://github.com/stonybrooknlp/ircot>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B"}. This record does not assert independent reproduction.

### LightRAG

F1: 9.7. Result ID: 69b9329b47f34ce924a2af5a.

[Reporting paper](<https://www.sota2.com/research/paper/69b8e0260636e5bf4afbec79.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78461e209131cea778bd.md>)

Recorded evaluation configuration: {"LLM":"GPT-4o-mini"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.