# Multi-hop Question Answering on MuSiQue (Recall %)

Source: [Multi-hop Question Answering on MuSiQue (Recall %)](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-musique-recall-percent>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-04T07:56:00.449Z

Evaluation of model performance on the MuSiQue dataset for Multi-hop Question Answering, specifically reporting the Recall percentage.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Multi-hop Question Answering |
| Dataset (including any stated split) | MuSiQue |
| Metric | Recall |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 6 of 6 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Recall](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-musique-recall-percent.md?metric=Recall>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Recall | Result date | Report paper |
| --- | --- | --- | --- |
| R1 Searcher-7B | 57.7 | Not recorded | 68fa7a4d1e209131cea82501 |
| CoRAG-8B | 54 | Not recorded | 68fa7a4d1e209131cea82501 |
| FrugalRAG-7B | 52.6 | Not recorded | 68fa7a4d1e209131cea82501 |
| SimpleDeepSearcher-7B | 50.4 | Not recorded | 68fa7a4d1e209131cea82501 |
| Search-R1-7B | 38.1 | Not recorded | 68fa7a4d1e209131cea82501 |
| O2 Searcher-3B | 37 | Not recorded | 68fa7a4d1e209131cea82501 |

### R1 Searcher-7B

Recall: 57.7. Result ID: 69a7e58d6dbb7075b94c9074.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4d1e209131cea82501.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77771e209131cea7356d.md>)

Recorded evaluation configuration: {"Avg Tokens":"4,665","FLOPs":"6.47 × 1013","Latency (s)":"0.1327","Search Count":"2.31"}. This record does not assert independent reproduction.

### CoRAG-8B

Recall: 54. Result ID: 69a7e58d6dbb7075b94c9076.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4d1e209131cea82501.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bfb1e209131cea8b9d6.md>)

Recorded evaluation configuration: {"Avg Tokens":"7,683","FLOPs":"1.23 × 1014","Latency (s)":"0.1472","Search Count":"4.00"}. This record does not assert independent reproduction.

### FrugalRAG-7B

Recall: 52.6. Result ID: 69a7e58d6dbb7075b94c9077.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4d1e209131cea82501.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4d1e209131cea82501.md>)

Recorded evaluation configuration: {"Avg Tokens":"11,914","FLOPs":"1.66 × 1014","Latency (s)":"0.4098","Search Count":"3.30"}. This record does not assert independent reproduction.

### SimpleDeepSearcher-7B

Recall: 50.4. Result ID: 69a7e58d6dbb7075b94c9073.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4d1e209131cea82501.md>)

Recorded evaluation configuration: {"Avg Tokens":"10,027","FLOPs":"1.35 × 1014","Latency (s)":"0.7366","Search Count":"2.86"}. This record does not assert independent reproduction.

### Search-R1-7B

Recall: 38.1. Result ID: 69a7e58d6dbb7075b94c9075.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4d1e209131cea82501.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a651e209131cea82e7b.md>)

Recorded evaluation configuration: {"Avg Tokens":"2,212","FLOPs":"3.14 × 1013","Latency (s)":"0.0676","Search Count":"1.36"}. This record does not assert independent reproduction.

### O2 Searcher-3B

Recall: 37. Result ID: 69a7e58d6dbb7075b94c9072.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4d1e209131cea82501.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78c71e209131cea7a784.md>)

Recorded evaluation configuration: {"Avg Tokens":"2,923","FLOPs":"1.74 × 1013","Latency (s)":"0.1009","Search Count":"1.95"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.