# Multi-hop Question Answering on HotpotQA (EM, F1, P, R)

Source: [Multi-hop Question Answering on HotpotQA (EM, F1, P, R)](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-hotpotqa-em-f1-p-r>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-21T10:25:39.753Z

Evaluation of model performance on the HotpotQA dataset for multi-hop question answering, reporting Exact Match (EM), F1 score, Precision (P), and Recall (R).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Multi-hop Question Answering |
| Dataset (including any stated split) | HotpotQA |
| Metric | EM |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [EM](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-hotpotqa-em-f1-p-r.md?metric=EM>): Higher is better; unit: SCALAR.

- [F1 Score](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-hotpotqa-em-f1-p-r.md?metric=F1%20Score>): Higher is better; unit: SCALAR.

- [Precision](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-hotpotqa-em-f1-p-r.md?metric=Precision>): Higher is better; unit: SCALAR.

- [Recall](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-hotpotqa-em-f1-p-r.md?metric=Recall>): Higher is better; unit: SCALAR.

## Recorded results

| Method | EM | Result date | Report paper |
| --- | --- | --- | --- |
| STRIDE-FT | 0.601 | Not recorded | 69e704a17d0172140ec7edb1 |
| DualRAG | 0.578 | Not recorded | 69e704a17d0172140ec7edb1 |
| STRIDE | 0.564 | Not recorded | 69e704a17d0172140ec7edb1 |
| DualRAG | 0.552 | Not recorded | 69e704a17d0172140ec7edb1 |
| Iter-RetGen | 0.551 | Not recorded | 69e704a17d0172140ec7edb1 |
| STRIDE | 0.549 | Not recorded | 69e704a17d0172140ec7edb1 |
| GenGround | 0.523 | Not recorded | 69e704a17d0172140ec7edb1 |
| RAG w/ CoT | 0.522 | Not recorded | 69e704a17d0172140ec7edb1 |
| Iter-RetGen | 0.519 | Not recorded | 69e704a17d0172140ec7edb1 |
| RAG w/ CoT | 0.501 | Not recorded | 69e704a17d0172140ec7edb1 |
| GenGround | 0.48 | Not recorded | 69e704a17d0172140ec7edb1 |
| SelfAsk | 0.449 | Not recorded | 69e704a17d0172140ec7edb1 |
| CoT | 0.346 | Not recorded | 69e704a17d0172140ec7edb1 |
| CoT | 0.22 | Not recorded | 69e704a17d0172140ec7edb1 |

### STRIDE-FT

EM: 0.601. Result ID: 69e74fa047f34ce924ce32ae.

[Reporting paper](<https://www.sota2.com/research/paper/69e704a17d0172140ec7edb1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e704a17d0172140ec7edb1.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-8B","Fine-tuning":"true"}. This record does not assert independent reproduction.

### DualRAG

EM: 0.578. Result ID: 69e74fa047f34ce924ce32a5.

[Reporting paper](<https://www.sota2.com/research/paper/69e704a17d0172140ec7edb1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bd71e209131cea8ad8b.md>)

Recorded evaluation configuration: {"Backbone":"GPT-4o-mini","Fine-tuning":"false"}. This record does not assert independent reproduction.

### STRIDE

EM: 0.564. Result ID: 69e74fa047f34ce924ce32a6.

[Reporting paper](<https://www.sota2.com/research/paper/69e704a17d0172140ec7edb1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e704a17d0172140ec7edb1.md>)

Recorded evaluation configuration: {"Backbone":"GPT-4o-mini","Fine-tuning":"false"}. This record does not assert independent reproduction.

### DualRAG

EM: 0.552. Result ID: 69e74fa047f34ce924ce32ac.

[Reporting paper](<https://www.sota2.com/research/paper/69e704a17d0172140ec7edb1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bd71e209131cea8ad8b.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-8B","Fine-tuning":"false"}. This record does not assert independent reproduction.

### Iter-RetGen

EM: 0.551. Result ID: 69e74fa047f34ce924ce32a3.

[Reporting paper](<https://www.sota2.com/research/paper/69e704a17d0172140ec7edb1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f21e209131cea4e48a.md>)

Recorded evaluation configuration: {"Backbone":"GPT-4o-mini","Fine-tuning":"false"}. This record does not assert independent reproduction.

### STRIDE

EM: 0.549. Result ID: 69e74fa047f34ce924ce32ad.

[Reporting paper](<https://www.sota2.com/research/paper/69e704a17d0172140ec7edb1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e704a17d0172140ec7edb1.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-8B","Fine-tuning":"false"}. This record does not assert independent reproduction.

### GenGround

EM: 0.523. Result ID: 69e74fa047f34ce924ce32ab.

[Reporting paper](<https://www.sota2.com/research/paper/69e704a17d0172140ec7edb1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74d91e209131cea6420c.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-8B","Fine-tuning":"false"}. This record does not assert independent reproduction.

### RAG w/ CoT

EM: 0.522. Result ID: 69e74fa047f34ce924ce32a2.

[Reporting paper](<https://www.sota2.com/research/paper/69e704a17d0172140ec7edb1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69b91e209131cea23c26.md>)

[Implementation](<https://github.com/huggingface/transformers/blob/master/examples/rag/>)

Recorded evaluation configuration: {"Backbone":"GPT-4o-mini","Fine-tuning":"false"}. This record does not assert independent reproduction.

### Iter-RetGen

EM: 0.519. Result ID: 69e74fa047f34ce924ce32aa.

[Reporting paper](<https://www.sota2.com/research/paper/69e704a17d0172140ec7edb1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f21e209131cea4e48a.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-8B","Fine-tuning":"false"}. This record does not assert independent reproduction.

### RAG w/ CoT

EM: 0.501. Result ID: 69e74fa047f34ce924ce32a8.

[Reporting paper](<https://www.sota2.com/research/paper/69e704a17d0172140ec7edb1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69b91e209131cea23c26.md>)

[Implementation](<https://github.com/huggingface/transformers/blob/master/examples/rag/>)

Recorded evaluation configuration: {"Backbone":"Qwen3-8B","Fine-tuning":"false"}. This record does not assert independent reproduction.

### GenGround

EM: 0.48. Result ID: 69e74fa047f34ce924ce32a4.

[Reporting paper](<https://www.sota2.com/research/paper/69e704a17d0172140ec7edb1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74d91e209131cea6420c.md>)

Recorded evaluation configuration: {"Backbone":"GPT-4o-mini","Fine-tuning":"false"}. This record does not assert independent reproduction.

### SelfAsk

EM: 0.449. Result ID: 69e74fa047f34ce924ce32a9.

[Reporting paper](<https://www.sota2.com/research/paper/69e704a17d0172140ec7edb1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70ef1e209131cea4e227.md>)

[Implementation](<https://github.com/ofirpress/self-ask>)

Recorded evaluation configuration: {"Backbone":"Qwen3-8B","Fine-tuning":"false"}. This record does not assert independent reproduction.

### CoT

EM: 0.346. Result ID: 69e74fa047f34ce924ce32a1.

[Reporting paper](<https://www.sota2.com/research/paper/69e704a17d0172140ec7edb1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Backbone":"GPT-4o-mini","Fine-tuning":"false"}. This record does not assert independent reproduction.

### CoT

EM: 0.22. Result ID: 69e74fa047f34ce924ce32a7.

[Reporting paper](<https://www.sota2.com/research/paper/69e704a17d0172140ec7edb1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-8B","Fine-tuning":"false"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
