# Multi-hop Question Answering on 2WikiMultiHopQA (test)

Source: [Multi-hop Question Answering on 2WikiMultiHopQA (test)](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-2wikimultihopqa-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-30T10:00:44.429Z

Evaluation of model performance on the test split of the 2WikiMultiHopQA dataset for multi-hop question answering capabilities.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Multi-hop Question Answering |
| Dataset (including any stated split) | 2WikiMultiHopQA (test) |
| Metric | EM |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 317 of 317 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [EM](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-2wikimultihopqa-test.md?metric=EM>): Higher is better; unit: PERCENT.

- [SQA Count](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-2wikimultihopqa-test.md?metric=SQA%20Count>): Higher is better; unit: SCALAR.

- [Coverage EM](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-2wikimultihopqa-test.md?metric=Coverage%20EM>): Higher is better; unit: PERCENT.

- [F1 Score](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-2wikimultihopqa-test.md?metric=F1%20Score>): Higher is better; unit: PERCENT.

- [Accuracy+](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-2wikimultihopqa-test.md?metric=Accuracy%2B>): Higher is better; unit: PERCENT.

- [Delta EM](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-2wikimultihopqa-test.md?metric=Delta%20EM>): Higher is better; unit: SCALAR.

- [AUC](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-2wikimultihopqa-test.md?metric=AUC>): Higher is better; unit: PERCENT.

- [Accuracy](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-2wikimultihopqa-test.md?metric=Accuracy>): Higher is better; unit: PERCENT.

- [R@2](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-2wikimultihopqa-test.md?metric=R%402>): Higher is better; unit: PERCENT.

- [R@5](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-2wikimultihopqa-test.md?metric=R%405>): Higher is better; unit: PERCENT.

- [Retrieved TUs](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-2wikimultihopqa-test.md?metric=Retrieved%20TUs>): Higher is better; unit: SCALAR.

- [Cited TUs](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-2wikimultihopqa-test.md?metric=Cited%20TUs>): Higher is better; unit: SCALAR.

- [Visited Entities](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-2wikimultihopqa-test.md?metric=Visited%20Entities>): Higher is better; unit: SCALAR.

- [Cited Entities](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-2wikimultihopqa-test.md?metric=Cited%20Entities>): Higher is better; unit: SCALAR.

## Recorded results

| Method | EM | Result date | Report paper |
| --- | --- | --- | --- |
| CJ | 73.9 | Not recorded | 69df1bc87d0172140ec7bbe8 |
| Search-R1 (EM) | 73.6 | Not recorded | 69df1bc87d0172140ec7bbe8 |
| CCS | 71.8 | Not recorded | 69df1bc87d0172140ec7bbe8 |
| GRPO | 69.8 | Not recorded | 6a210661c10484bac23efee7 |
| ARBOR | 69.8 | Not recorded | 6a210661c10484bac23efee7 |
| DAPO | 67.6 | Not recorded | 6a210661c10484bac23efee7 |
| Search-R1 (EM) | 66.8 | Not recorded | 69df1bc87d0172140ec7bbe8 |
| TTRL | 65.3 | Not recorded | 69df1bc87d0172140ec7bbe8 |
| GRPO | 64.8 | Not recorded | 6a210661c10484bac23efee7 |
| QuCo-RAG | 64.6 | Not recorded | 694a22219eebe296e72aa7df |
| ARBOR | 64.2 | Not recorded | 6a210661c10484bac23efee7 |
| ARBOR | 64.2 | Not recorded | 6a210661c10484bac23efee7 |
| DAPO | 63.8 | Not recorded | 6a210661c10484bac23efee7 |
| Workflow-R1-Search | 63.3 | Not recorded | 6981813ea8b01e76cc8e23e2 |
| Search-o1 | 62.9 | Not recorded | 69df1bc87d0172140ec7bbe8 |
| Relink | 62.8 | Not recorded | 6965d1b16343fa78c8323920 |
| Graph-AdaptR1 | 61.72 | Not recorded | 6a1d11ecdbd7150506f83e74 |
| Search-R1 (EM) | 61.7 | Not recorded | 69df1bc87d0172140ec7bbe8 |
| GRPO | 60.9 | Not recorded | 6a210661c10484bac23efee7 |
| CCS | 60.6 | Not recorded | 69df1bc87d0172140ec7bbe8 |
| OPERA (MAPGRPO) | 60.2 | Not recorded | 68fa7aca1e209131cea851c1 |
| DAPO | 60.2 | Not recorded | 6a210661c10484bac23efee7 |
| SR-RAG | 60 | Not recorded | 694a22219eebe296e72aa7df |
| QuCo-RAG | 59.7 | Not recorded | 694a22219eebe296e72aa7df |
| FS-RAG | 59.5 | Not recorded | 694a22219eebe296e72aa7df |
| ProGraph-R1 | 59.38 | Not recorded | 69784684a2b28e761d87c4dc |
| Graph-R1 | 58.59 | Not recorded | 6a1d11ecdbd7150506f83e74 |
| HippoRAG | 57.8 | Not recorded | 6965d1b16343fa78c8323920 |
| IRCOT QA | 57.7 | Not recorded | 68fa6fd81e209131cea4791d |
| CCS | 56.7 | Not recorded | 69df1bc87d0172140ec7bbe8 |
| CJ | 56 | Not recorded | 69df1bc87d0172140ec7bbe8 |
| ProGraph-R1 | 55.47 | Not recorded | 69784684a2b28e761d87c4dc |
| Graph-R1 | 55.47 | Not recorded | 69784684a2b28e761d87c4dc |
| RLIF | 55.2 | Not recorded | 69df1bc87d0172140ec7bbe8 |
| Wo-RAG | 54.7 | Not recorded | 694a22219eebe296e72aa7df |
| FABLE(docs) | 52.5 | Not recorded | 697846c1a2b28e761d87c694 |
| Gemini-2.5-Pro | 52.02 | Not recorded | 697846c1a2b28e761d87c694 |
| RLIF | 51.4 | Not recorded | 69df1bc87d0172140ec7bbe8 |
| SR-RAG | 51 | Not recorded | 694a22219eebe296e72aa7df |
| TIGRAG | 50.9 | Not recorded | 6a434d95ba73165dbb743bf1 |
| HippoRAG2 | 50.2 | Not recorded | 6a434d95ba73165dbb743bf1 |
| Wo-RAG | 50.1 | Not recorded | 694a22219eebe296e72aa7df |
| IQATR | 50 | Not recorded | 68fa78d11e209131cea7a8f1 |
| FABLE(nodes) | 50 | Not recorded | 697846c1a2b28e761d87c694 |
| Graph-R1 | 50 | Not recorded | 69784684a2b28e761d87c4dc |
| QuCo-RAG | 50 | Not recorded | 694a22219eebe296e72aa7df |
| FLARE | 49.8 | Not recorded | 694a22219eebe296e72aa7df |
| IRCOT | 49.7 | Not recorded | 68fa78d11e209131cea7a8f1 |
| CJ | 49.5 | Not recorded | 69df1bc87d0172140ec7bbe8 |
| xRAG | 48.8 | Not recorded | 69608b7753fdd5c3617443c4 |
| TTRL | 48.8 | Not recorded | 69df1bc87d0172140ec7bbe8 |
| Web-Tool | 48.3 | Not recorded | 694a22219eebe296e72aa7df |
| Search-o1 | 48.1 | Not recorded | 69df1bc87d0172140ec7bbe8 |
| FS-RAG | 47.3 | Not recorded | 694a22219eebe296e72aa7df |
| RAPTOR | 46.7 | Not recorded | 6965d1b16343fa78c8323920 |
| LightRAG | 45.7 | Not recorded | 6a434d95ba73165dbb743bf1 |
| TTRL | 45.5 | Not recorded | 69df1bc87d0172140ec7bbe8 |
| Search-AdaptR1 | 45.31 | Not recorded | 6a1d11ecdbd7150506f83e74 |
| Llama-3.1-8B Baseline | 44.6 | Not recorded | 68fa78d11e209131cea7a8f1 |
| QCompiler | 44.5 | Not recorded | 68fa78981e209131cea79335 |
| HippoRAG2 | 44.5 | Not recorded | 697846c1a2b28e761d87c694 |
| RLIF | 44.4 | Not recorded | 69df1bc87d0172140ec7bbe8 |
| NaiveRAG | 44.4 | Not recorded | 6a434d95ba73165dbb743bf1 |
| BGM | 44.3 | Not recorded | 68fa7aca1e209131cea851c1 |
| IRCoT | 43.3 | Not recorded | 68fa7aca1e209131cea851c1 |
| Adaptive-Note | 43.2 | Not recorded | 68fa78d11e209131cea7a8f1 |
| Web-Tool | 42.9 | Not recorded | 694a22219eebe296e72aa7df |
| InForage | 42.8 | Not recorded | 69a90ddc2d603e6de3e40587 |
| OPERA (CoT) | 42.3 | Not recorded | 68fa7aca1e209131cea851c1 |
| Search-R1 (PPO) | 41.4 | Not recorded | 6981813ea8b01e76cc8e23e2 |
| CriticSearch | 40.9 | Not recorded | 69a90ddc2d603e6de3e40587 |
| Adaptive-RAG | 40.6 | Not recorded | 68fa78d11e209131cea7a8f1 |
| SelfAsk | 40.1 | Not recorded | 68fa6fd81e209131cea4791d |
| AutoRefine-Base | 39.3 | Not recorded | 69a90ddc2d603e6de3e40587 |
| Gemini-2.5-Flash | 38.5 | Not recorded | 697846c1a2b28e761d87c694 |
| QuCo-RAG | 38.4 | Not recorded | 694a22219eebe296e72aa7df |
| AutoRefine-Instruct | 38 | Not recorded | 69a90ddc2d603e6de3e40587 |
| O2-Searcher | 37.4 | Not recorded | 69a90ddc2d603e6de3e40587 |
| CoT-SC + VE | 37.2 | Not recorded | 68fa70c91e209131cea4d13b |
| Search-R1 | 36.72 | Not recorded | 69784684a2b28e761d87c4dc |

### CJ

EM: 73.9. Result ID: 69df645247f34ce924c8ade1.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bc87d0172140ec7bbe8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f6b1e209131cea4574f.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B","Supervision Strategy":"W.O. Gold Supervision"}. This record does not assert independent reproduction.

### Search-R1 (EM)

EM: 73.6. Result ID: 69df645247f34ce924c8addf.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bc87d0172140ec7bbe8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a651e209131cea82e7b.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B","Supervision Strategy":"W. Gold Supervision"}. This record does not assert independent reproduction.

### CCS

EM: 71.8. Result ID: 69df645247f34ce924c8ade3.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bc87d0172140ec7bbe8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69df1bc87d0172140ec7bbe8.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B","Supervision Strategy":"W.O. Gold Supervision"}. This record does not assert independent reproduction.

### GRPO

EM: 69.8. Result ID: 6a213912fbc373592c1cc536.

[Reporting paper](<https://www.sota2.com/research/paper/6a210661c10484bac23efee7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73101e209131cea5a395.md>)

[Implementation](<https://github.com/deepseek-ai/DeepSeek-Math>)

Recorded evaluation configuration: {"Backbone":"Qwen3-14B"}. This record does not assert independent reproduction.

### ARBOR

EM: 69.8. Result ID: 6a213912fbc373592c1cc538.

[Reporting paper](<https://www.sota2.com/research/paper/6a210661c10484bac23efee7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a210661c10484bac23efee7.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-14B"}. This record does not assert independent reproduction.

### DAPO

EM: 67.6. Result ID: 6a213912fbc373592c1cc537.

[Reporting paper](<https://www.sota2.com/research/paper/6a210661c10484bac23efee7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a81e209131cea79ac6.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-14B"}. This record does not assert independent reproduction.

### Search-R1 (EM)

EM: 66.8. Result ID: 69df645247f34ce924c8add4.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bc87d0172140ec7bbe8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a651e209131cea82e7b.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-4B-Instruct-2507","Supervision Strategy":"W. Gold Supervision"}. This record does not assert independent reproduction.

### TTRL

EM: 65.3. Result ID: 69df645247f34ce924c8ade0.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bc87d0172140ec7bbe8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79ce1e209131cea7f7aa.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B","Supervision Strategy":"W.O. Gold Supervision"}. This record does not assert independent reproduction.

### GRPO

EM: 64.8. Result ID: 6a213912fbc373592c1cc532.

[Reporting paper](<https://www.sota2.com/research/paper/6a210661c10484bac23efee7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73101e209131cea5a395.md>)

[Implementation](<https://github.com/deepseek-ai/DeepSeek-Math>)

Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction.

### QuCo-RAG

EM: 64.6. Result ID: 6996b5d45698665ec4005595.

[Reporting paper](<https://www.sota2.com/research/paper/694a22219eebe296e72aa7df.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694a22219eebe296e72aa7df.md>)

[Implementation](<https://github.com/ZhishanQ/QuCo-RAG>)

Recorded evaluation configuration: {"Backbone":"GPT-4.1"}. This record does not assert independent reproduction.

### ARBOR

EM: 64.2. Result ID: 6a213912fbc373592c1cc530.

[Reporting paper](<https://www.sota2.com/research/paper/6a210661c10484bac23efee7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a210661c10484bac23efee7.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction.

### ARBOR

EM: 64.2. Result ID: 6a213912fbc373592c1cc534.

[Reporting paper](<https://www.sota2.com/research/paper/6a210661c10484bac23efee7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a210661c10484bac23efee7.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction.

### DAPO

EM: 63.8. Result ID: 6a213912fbc373592c1cc533.

[Reporting paper](<https://www.sota2.com/research/paper/6a210661c10484bac23efee7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a81e209131cea79ac6.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction.

### Workflow-R1-Search

EM: 63.3. Result ID: 69960eb35698665ec44ac8af.

[Reporting paper](<https://www.sota2.com/research/paper/6981813ea8b01e76cc8e23e2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6981813ea8b01e76cc8e23e2.md>)

Recorded evaluation configuration: {"Multi-turn":true,"Backbone":"Qwen2.5-32B-Instruct"}. This record does not assert independent reproduction.

### Search-o1

EM: 62.9. Result ID: 69df645247f34ce924c8addd.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bc87d0172140ec7bbe8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76911e209131cea6dca9.md>)

[Implementation](<https://github.com/sunnynexus/Search-o1>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B","Supervision Strategy":"Model Inference"}. This record does not assert independent reproduction.

### Relink

EM: 62.8. Result ID: 69968efb5698665ec4d7da37.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1b16343fa78c8323920.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6965d1b16343fa78c8323920.md>)

Recorded evaluation configuration: {"Method Type":"Proposed","Backbone LLM":"deepseek-v3-0324"}. This record does not assert independent reproduction.

### Graph-AdaptR1

EM: 61.72. Result ID: 6a1d489bfbc373592c169b73.

[Reporting paper](<https://www.sota2.com/research/paper/6a1d11ecdbd7150506f83e74.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a1d11ecdbd7150506f83e74.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct","Interaction Type":"Training","Knowledge Representation":"Graph-based"}. This record does not assert independent reproduction.

### Search-R1 (EM)

EM: 61.7. Result ID: 69df645247f34ce924c8adc9.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bc87d0172140ec7bbe8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a651e209131cea82e7b.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct","Supervision Strategy":"W. Gold Supervision"}. This record does not assert independent reproduction.

### GRPO

EM: 60.9. Result ID: 6a213912fbc373592c1cc52e.

[Reporting paper](<https://www.sota2.com/research/paper/6a210661c10484bac23efee7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73101e209131cea5a395.md>)

[Implementation](<https://github.com/deepseek-ai/DeepSeek-Math>)

Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction.

### CCS

EM: 60.6. Result ID: 69df645247f34ce924c8add8.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bc87d0172140ec7bbe8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69df1bc87d0172140ec7bbe8.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-4B-Instruct-2507","Supervision Strategy":"W.O. Gold Supervision"}. This record does not assert independent reproduction.

### OPERA (MAPGRPO)

EM: 60.2. Result ID: 6a0c1d11fbc373592c021f2f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7aca1e209131cea851c1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7aca1e209131cea851c1.md>)

Recorded evaluation configuration: {"Type":"RL"}. This record does not assert independent reproduction.

### DAPO

EM: 60.2. Result ID: 6a213912fbc373592c1cc52f.

[Reporting paper](<https://www.sota2.com/research/paper/6a210661c10484bac23efee7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a81e209131cea79ac6.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction.

### SR-RAG

EM: 60. Result ID: 6996b5d45698665ec4005582.

[Reporting paper](<https://www.sota2.com/research/paper/694a22219eebe296e72aa7df.md>)

Recorded evaluation configuration: {"Backbone":"GPT-4.1"}. This record does not assert independent reproduction.

### QuCo-RAG

EM: 59.7. Result ID: 6996b5d45698665ec4005596.

[Reporting paper](<https://www.sota2.com/research/paper/694a22219eebe296e72aa7df.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694a22219eebe296e72aa7df.md>)

[Implementation](<https://github.com/ZhishanQ/QuCo-RAG>)

Recorded evaluation configuration: {"Backbone":"GPT-5-chat"}. This record does not assert independent reproduction.

### FS-RAG

EM: 59.5. Result ID: 6996b5d45698665ec4005586.

[Reporting paper](<https://www.sota2.com/research/paper/694a22219eebe296e72aa7df.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fd81e209131cea4791d.md>)

[Implementation](<https://github.com/stonybrooknlp/ircot>)

Recorded evaluation configuration: {"Backbone":"GPT-4.1"}. This record does not assert independent reproduction.

### ProGraph-R1

EM: 59.38. Result ID: 69966f255698665ec4b61b42.

[Reporting paper](<https://www.sota2.com/research/paper/69784684a2b28e761d87c4dc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69784684a2b28e761d87c4dc.md>)

Recorded evaluation configuration: {"Base Model":"Qwen2.5-7B-Instruct","Optimization Method":"Training","Knowledge Interaction":"Graph-based knowledge"}. This record does not assert independent reproduction.

### Graph-R1

EM: 58.59. Result ID: 6a1d489bfbc373592c169b72.

[Reporting paper](<https://www.sota2.com/research/paper/6a1d11ecdbd7150506f83e74.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a431e209131cea82033.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct","Interaction Type":"Training","Knowledge Representation":"Graph-based"}. This record does not assert independent reproduction.

### HippoRAG

EM: 57.8. Result ID: 69968efb5698665ec4d7da36.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1b16343fa78c8323920.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76981e209131cea6dff9.md>)

Recorded evaluation configuration: {"Method Type":"Hybrid","Backbone LLM":"deepseek-v3-0324"}. This record does not assert independent reproduction.

### IRCOT QA

EM: 57.7. Result ID: 6990edbc3a6c314849045d3b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fd81e209131cea4791d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fd81e209131cea4791d.md>)

[Implementation](<https://github.com/stonybrooknlp/ircot>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### CCS

EM: 56.7. Result ID: 69df645247f34ce924c8adcd.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bc87d0172140ec7bbe8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69df1bc87d0172140ec7bbe8.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct","Supervision Strategy":"W.O. Gold Supervision"}. This record does not assert independent reproduction.

### CJ

EM: 56. Result ID: 69df645247f34ce924c8adcb.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bc87d0172140ec7bbe8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f6b1e209131cea4574f.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct","Supervision Strategy":"W.O. Gold Supervision"}. This record does not assert independent reproduction.

### ProGraph-R1

EM: 55.47. Result ID: 69966f255698665ec4b61b3a.

[Reporting paper](<https://www.sota2.com/research/paper/69784684a2b28e761d87c4dc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69784684a2b28e761d87c4dc.md>)

Recorded evaluation configuration: {"Base Model":"Qwen2.5-3B-Instruct","Optimization Method":"Training","Knowledge Interaction":"Graph-based knowledge"}. This record does not assert independent reproduction.

### Graph-R1

EM: 55.47. Result ID: 69966f255698665ec4b61b41.

[Reporting paper](<https://www.sota2.com/research/paper/69784684a2b28e761d87c4dc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a431e209131cea82033.md>)

Recorded evaluation configuration: {"Base Model":"Qwen2.5-7B-Instruct","Optimization Method":"Training","Knowledge Interaction":"Graph-based knowledge"}. This record does not assert independent reproduction.

### RLIF

EM: 55.2. Result ID: 69df645247f34ce924c8ade2.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bc87d0172140ec7bbe8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a8d1e209131cea83dc9.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B","Supervision Strategy":"W.O. Gold Supervision"}. This record does not assert independent reproduction.

### Wo-RAG

EM: 54.7. Result ID: 6996b5d45698665ec400557e.

[Reporting paper](<https://www.sota2.com/research/paper/694a22219eebe296e72aa7df.md>)

Recorded evaluation configuration: {"Backbone":"GPT-4.1"}. This record does not assert independent reproduction.

### FABLE(docs)

EM: 52.5. Result ID: 69966dba5698665ec4b4949a.

[Reporting paper](<https://www.sota2.com/research/paper/697846c1a2b28e761d87c694.md>)

[Method origin paper](<https://www.sota2.com/research/paper/697846c1a2b28e761d87c694.md>)

Recorded evaluation configuration: {"selection\_strategy":"LLM-guided","bi\_path\_fusion":true,"retrieval\_unit":"documents"}. This record does not assert independent reproduction.

### Gemini-2.5-Pro

EM: 52.02. Result ID: 69966dba5698665ec4b49497.

[Reporting paper](<https://www.sota2.com/research/paper/697846c1a2b28e761d87c694.md>)

Recorded evaluation configuration: {"category":"LLM-in-context","mode":"Full-context Inference"}. This record does not assert independent reproduction.

### RLIF

EM: 51.4. Result ID: 69df645247f34ce924c8add7.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bc87d0172140ec7bbe8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a8d1e209131cea83dc9.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-4B-Instruct-2507","Supervision Strategy":"W.O. Gold Supervision"}. This record does not assert independent reproduction.

### SR-RAG

EM: 51. Result ID: 6996b5d45698665ec4005583.

[Reporting paper](<https://www.sota2.com/research/paper/694a22219eebe296e72aa7df.md>)

Recorded evaluation configuration: {"Backbone":"GPT-5-chat"}. This record does not assert independent reproduction.

### TIGRAG

EM: 50.9. Result ID: 6a4393b1fbc373592c96263a.

[Reporting paper](<https://www.sota2.com/research/paper/6a434d95ba73165dbb743bf1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a434d95ba73165dbb743bf1.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HippoRAG2

EM: 50.2. Result ID: 6a4393b1fbc373592c962633.

[Reporting paper](<https://www.sota2.com/research/paper/6a434d95ba73165dbb743bf1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79821e209131cea7de8a.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Wo-RAG

EM: 50.1. Result ID: 6996b5d45698665ec400557f.

[Reporting paper](<https://www.sota2.com/research/paper/694a22219eebe296e72aa7df.md>)

Recorded evaluation configuration: {"Backbone":"GPT-5-chat"}. This record does not assert independent reproduction.

### IQATR

EM: 50. Result ID: 6995a3f33badfaffe6a12fde.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78d11e209131cea7a8f1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78d11e209131cea7a8f1.md>)

[Implementation](<https://leeds1219.github.io/ReSCORE>)

Recorded evaluation configuration: {"LLM Backbone":"Llama-3.1-8B","Retriever":"Contriever","Retriever Fine-tuning":"ReSCORE"}. This record does not assert independent reproduction.

### FABLE(nodes)

EM: 50. Result ID: 69966dba5698665ec4b4949b.

[Reporting paper](<https://www.sota2.com/research/paper/697846c1a2b28e761d87c694.md>)

[Method origin paper](<https://www.sota2.com/research/paper/697846c1a2b28e761d87c694.md>)

Recorded evaluation configuration: {"selection\_strategy":"LLM-guided","bi\_path\_fusion":true,"retrieval\_unit":"nodes"}. This record does not assert independent reproduction.

### Graph-R1

EM: 50. Result ID: 69966f255698665ec4b61b39.

[Reporting paper](<https://www.sota2.com/research/paper/69784684a2b28e761d87c4dc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a431e209131cea82033.md>)

Recorded evaluation configuration: {"Base Model":"Qwen2.5-3B-Instruct","Optimization Method":"Training","Knowledge Interaction":"Graph-based knowledge"}. This record does not assert independent reproduction.

### QuCo-RAG

EM: 50. Result ID: 6996b5d45698665ec4005593.

[Reporting paper](<https://www.sota2.com/research/paper/694a22219eebe296e72aa7df.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694a22219eebe296e72aa7df.md>)

[Implementation](<https://github.com/ZhishanQ/QuCo-RAG>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-32B"}. This record does not assert independent reproduction.

### FLARE

EM: 49.8. Result ID: 6996b5d45698665ec400558a.

[Reporting paper](<https://www.sota2.com/research/paper/694a22219eebe296e72aa7df.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f21e209131cea4e444.md>)

Recorded evaluation configuration: {"Backbone":"GPT-4.1"}. This record does not assert independent reproduction.

### IRCOT

EM: 49.7. Result ID: 6995a3f33badfaffe6a12fda.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78d11e209131cea7a8f1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fd81e209131cea4791d.md>)

[Implementation](<https://github.com/stonybrooknlp/ircot>)

Recorded evaluation configuration: {"LLM Backbone":"Flan-T5-XL","Retriever":"BM25"}. This record does not assert independent reproduction.

### CJ

EM: 49.5. Result ID: 69df645247f34ce924c8add6.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bc87d0172140ec7bbe8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f6b1e209131cea4574f.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-4B-Instruct-2507","Supervision Strategy":"W.O. Gold Supervision"}. This record does not assert independent reproduction.

### xRAG

EM: 48.8. Result ID: 699696705698665ec4dfe510.

[Reporting paper](<https://www.sota2.com/research/paper/69608b7753fdd5c3617443c4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76161e209131cea6b55d.md>)

Recorded evaluation configuration: {"Comp. rate":"x128","Retrieval status":"w/ retrieval"}. This record does not assert independent reproduction.

### TTRL

EM: 48.8. Result ID: 69df645247f34ce924c8add5.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bc87d0172140ec7bbe8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79ce1e209131cea7f7aa.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-4B-Instruct-2507","Supervision Strategy":"W.O. Gold Supervision"}. This record does not assert independent reproduction.

### Web-Tool

EM: 48.3. Result ID: 6996b5d45698665ec4005592.

[Reporting paper](<https://www.sota2.com/research/paper/694a22219eebe296e72aa7df.md>)

Recorded evaluation configuration: {"Backbone":"GPT-5-chat"}. This record does not assert independent reproduction.

### Search-o1

EM: 48.1. Result ID: 69df645247f34ce924c8adc7.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bc87d0172140ec7bbe8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76911e209131cea6dca9.md>)

[Implementation](<https://github.com/sunnynexus/Search-o1>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct","Supervision Strategy":"Model Inference"}. This record does not assert independent reproduction.

### FS-RAG

EM: 47.3. Result ID: 6996b5d45698665ec4005587.

[Reporting paper](<https://www.sota2.com/research/paper/694a22219eebe296e72aa7df.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fd81e209131cea4791d.md>)

[Implementation](<https://github.com/stonybrooknlp/ircot>)

Recorded evaluation configuration: {"Backbone":"GPT-5-chat"}. This record does not assert independent reproduction.

### RAPTOR

EM: 46.7. Result ID: 69968efb5698665ec4d7da31.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1b16343fa78c8323920.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71fe1e209131cea53fc2.md>)

Recorded evaluation configuration: {"Method Type":"Text-based","Backbone LLM":"deepseek-v3-0324"}. This record does not assert independent reproduction.

### LightRAG

EM: 45.7. Result ID: 6a4393b1fbc373592c962638.

[Reporting paper](<https://www.sota2.com/research/paper/6a434d95ba73165dbb743bf1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78461e209131cea778bd.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### TTRL

EM: 45.5. Result ID: 69df645247f34ce924c8adca.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bc87d0172140ec7bbe8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79ce1e209131cea7f7aa.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct","Supervision Strategy":"W.O. Gold Supervision"}. This record does not assert independent reproduction.

### Search-AdaptR1

EM: 45.31. Result ID: 6a1d489bfbc373592c169b71.

[Reporting paper](<https://www.sota2.com/research/paper/6a1d11ecdbd7150506f83e74.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a1d11ecdbd7150506f83e74.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct","Interaction Type":"Training","Knowledge Representation":"Chunk-based"}. This record does not assert independent reproduction.

### Llama-3.1-8B Baseline

EM: 44.6. Result ID: 6995a3f33badfaffe6a12fdc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78d11e209131cea7a8f1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eae1e209131cea41685.md>)

[Implementation](<https://github.com/facebookresearch/llama>)

Recorded evaluation configuration: {"LLM Backbone":"Llama-3.1-8B","Retriever":"BM25"}. This record does not assert independent reproduction.

### QCompiler

EM: 44.5. Result ID: 699593773badfaffe68de7bb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78981e209131cea79335.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78981e209131cea79335.md>)

Recorded evaluation configuration: {"Strategy":"Query Understanding","Base Model":"Llama3.2-3B-Instruct","Fine-tuned":true}. This record does not assert independent reproduction.

### HippoRAG2

EM: 44.5. Result ID: 69966dba5698665ec4b49494.

[Reporting paper](<https://www.sota2.com/research/paper/697846c1a2b28e761d87c694.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79821e209131cea7de8a.md>)

Recorded evaluation configuration: {"category":"Structure-Enhanced RAG"}. This record does not assert independent reproduction.

### RLIF

EM: 44.4. Result ID: 69df645247f34ce924c8adcc.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bc87d0172140ec7bbe8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a8d1e209131cea83dc9.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct","Supervision Strategy":"W.O. Gold Supervision"}. This record does not assert independent reproduction.

### NaiveRAG

EM: 44.4. Result ID: 6a4393b1fbc373592c962639.

[Reporting paper](<https://www.sota2.com/research/paper/6a434d95ba73165dbb743bf1.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BGM

EM: 44.3. Result ID: 6a0c1d11fbc373592c021f2e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7aca1e209131cea851c1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72481e209131cea55871.md>)

Recorded evaluation configuration: {"Type":"RL"}. This record does not assert independent reproduction.

### IRCoT

EM: 43.3. Result ID: 6a0c1d11fbc373592c021f2b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7aca1e209131cea851c1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fd81e209131cea4791d.md>)

[Implementation](<https://github.com/stonybrooknlp/ircot>)

Recorded evaluation configuration: {"Type":"CoT"}. This record does not assert independent reproduction.

### Adaptive-Note

EM: 43.2. Result ID: 6995a3f33badfaffe6a12fd9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78d11e209131cea7a8f1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77e01e209131cea75bac.md>)

Recorded evaluation configuration: {"LLM Backbone":"GPT-3.5","Retriever":"BM25"}. This record does not assert independent reproduction.

### Web-Tool

EM: 42.9. Result ID: 6996b5d45698665ec4005591.

[Reporting paper](<https://www.sota2.com/research/paper/694a22219eebe296e72aa7df.md>)

Recorded evaluation configuration: {"Backbone":"GPT-4.1"}. This record does not assert independent reproduction.

### InForage

EM: 42.8. Result ID: 69a9292d6dbb7075b951fc53.

[Reporting paper](<https://www.sota2.com/research/paper/69a90ddc2d603e6de3e40587.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b841e209131cea88d2f.md>)

Recorded evaluation configuration: {"Retrieval":"Agent w/ Retrieval"}. This record does not assert independent reproduction.

### OPERA (CoT)

EM: 42.3. Result ID: 6a0c1d11fbc373592c021f2c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7aca1e209131cea851c1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7aca1e209131cea851c1.md>)

Recorded evaluation configuration: {"Type":"CoT"}. This record does not assert independent reproduction.

### Search-R1 (PPO)

EM: 41.4. Result ID: 69960eb35698665ec44ac8ae.

[Reporting paper](<https://www.sota2.com/research/paper/6981813ea8b01e76cc8e23e2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a651e209131cea82e7b.md>)

Recorded evaluation configuration: {"Multi-turn":true,"Backbone":"Qwen2.5-32B-Instruct"}. This record does not assert independent reproduction.

### CriticSearch

EM: 40.9. Result ID: 69a9292d6dbb7075b951fc54.

[Reporting paper](<https://www.sota2.com/research/paper/69a90ddc2d603e6de3e40587.md>)

[Method origin paper](<https://www.sota2.com/research/paper/691bfd786750be83fe5ce760.md>)

Recorded evaluation configuration: {"Retrieval":"Agent w/ Retrieval"}. This record does not assert independent reproduction.

### Adaptive-RAG

EM: 40.6. Result ID: 6995a3f33badfaffe6a12fdb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78d11e209131cea7a8f1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72ac1e209131cea57c66.md>)

Recorded evaluation configuration: {"LLM Backbone":"Flan-T5-XL","Retriever":"BM25"}. This record does not assert independent reproduction.

### SelfAsk

EM: 40.1. Result ID: 6990edbc3a6c314849045d38.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fd81e209131cea4791d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70ef1e209131cea4e227.md>)

[Implementation](<https://github.com/ofirpress/self-ask>)

Recorded evaluation configuration: {"Authors":"Press et al., 2022"}. This record does not assert independent reproduction.

### AutoRefine-Base

EM: 39.3. Result ID: 69a9292d6dbb7075b951fc52.

[Reporting paper](<https://www.sota2.com/research/paper/69a90ddc2d603e6de3e40587.md>)

Recorded evaluation configuration: {"Retrieval":"Agent w/ Retrieval"}. This record does not assert independent reproduction.

### Gemini-2.5-Flash

EM: 38.5. Result ID: 69966dba5698665ec4b49496.

[Reporting paper](<https://www.sota2.com/research/paper/697846c1a2b28e761d87c694.md>)

Recorded evaluation configuration: {"category":"LLM-in-context","mode":"Full-context Inference"}. This record does not assert independent reproduction.

### QuCo-RAG

EM: 38.4. Result ID: 6996b5d45698665ec4005594.

[Reporting paper](<https://www.sota2.com/research/paper/694a22219eebe296e72aa7df.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694a22219eebe296e72aa7df.md>)

[Implementation](<https://github.com/ZhishanQ/QuCo-RAG>)

Recorded evaluation configuration: {"Backbone":"Llama-3-8B"}. This record does not assert independent reproduction.

### AutoRefine-Instruct

EM: 38. Result ID: 69a9292d6dbb7075b951fc51.

[Reporting paper](<https://www.sota2.com/research/paper/69a90ddc2d603e6de3e40587.md>)

Recorded evaluation configuration: {"Retrieval":"Agent w/ Retrieval"}. This record does not assert independent reproduction.

### O2-Searcher

EM: 37.4. Result ID: 69a9292d6dbb7075b951fc50.

[Reporting paper](<https://www.sota2.com/research/paper/69a90ddc2d603e6de3e40587.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78c71e209131cea7a784.md>)

Recorded evaluation configuration: {"Retrieval":"Agent w/ Retrieval"}. This record does not assert independent reproduction.

### CoT-SC + VE

EM: 37.2. Result ID: 699140323a6c31484906cb09.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70c91e209131cea4d13b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70c91e209131cea4d13b.md>)

[Implementation](<https://github.com/RuochenZhao/Verify-and-Edit>)

Recorded evaluation configuration: {"knowledge":"Dataset","Model":"GPT-3 davinci-003"}. This record does not assert independent reproduction.

### Search-R1

EM: 36.72. Result ID: 69966f255698665ec4b61b3f.

[Reporting paper](<https://www.sota2.com/research/paper/69784684a2b28e761d87c4dc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a651e209131cea82e7b.md>)

Recorded evaluation configuration: {"Base Model":"Qwen2.5-7B-Instruct","Optimization Method":"Training","Knowledge Interaction":"Chunk-based knowledge"}. This record does not assert independent reproduction.

Page 1 of 4. This is an index page, not the full collection.

- [Next index page](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-2wikimultihopqa-test.md?metric=EM&page=2>): Follow this link to discover more pages.
