# Multi-hop Question Answering on Bamboogle out-of-domain (test)

Source: [Multi-hop Question Answering on Bamboogle out-of-domain (test)](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-bamboogle-out-of-domain-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:34:24.302Z

Evaluation of model performance on the test split of the Bamboogle out-of-domain evaluation set for Multi-hop Question Answering.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Multi-hop Question Answering |
| Dataset (including any stated split) | Bamboogle out-of-domain (test) |
| Metric | Accuracy (R) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy (R)](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-bamboogle-out-of-domain-test.md?metric=Accuracy%20(R)>): Higher is better; unit: PERCENT.

- [Accuracy (L)](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-bamboogle-out-of-domain-test.md?metric=Accuracy%20(L)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy (R) | Result date | Report paper |
| --- | --- | --- | --- |
| DLLM-Searcher | 68.8 | Not recorded | 698abbaac97a0b3e3b5ddffe |
| R1Searcher | 66.4 | Not recorded | 698abbaac97a0b3e3b5ddffe |
| WebSailor | 57.6 | Not recorded | 698abbaac97a0b3e3b5ddffe |
| ReARTeR | 49.6 | Not recorded | 698abbaac97a0b3e3b5ddffe |
| Search-o1 | 49.6 | Not recorded | 698abbaac97a0b3e3b5ddffe |
| Search-R1 | 47.2 | Not recorded | 698abbaac97a0b3e3b5ddffe |
| LLaDA | 46.4 | Not recorded | 698abbaac97a0b3e3b5ddffe |
| CR-Planner | 35.2 | Not recorded | 698abbaac97a0b3e3b5ddffe |
| IRCoT | 32 | Not recorded | 698abbaac97a0b3e3b5ddffe |
| Iter-RetGen | 26.4 | Not recorded | 698abbaac97a0b3e3b5ddffe |
| Adaptive-RAG | 21.6 | Not recorded | 698abbaac97a0b3e3b5ddffe |
| SuRe | 17.6 | Not recorded | 698abbaac97a0b3e3b5ddffe |
| Selective-Context | 15.2 | Not recorded | 698abbaac97a0b3e3b5ddffe |
| Dream | 12 | Not recorded | 698abbaac97a0b3e3b5ddffe |

### DLLM-Searcher

Accuracy (R): 68.8. Result ID: 699607945698665ec43efdbc.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaac97a0b3e3b5ddffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/698abbaac97a0b3e3b5ddffe.md>)

[Implementation](<https://github.com/bubble65/DLLM-Searcher>)

Recorded evaluation configuration: {"Category":"dLLMs Agent","paradigm":"P-ReAct","training":"VRPO","backbone":"SDAR"}. This record does not assert independent reproduction.

### R1Searcher

Accuracy (R): 66.4. Result ID: 699607945698665ec43efdb9.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaac97a0b3e3b5ddffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77771e209131cea7356d.md>)

Recorded evaluation configuration: {"Category":"ARM-based LLMs Agent","setup":"modified (5.1.3)","search\_mode":"best of local/Google search"}. This record does not assert independent reproduction.

### WebSailor

Accuracy (R): 57.6. Result ID: 699607945698665ec43efdb8.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaac97a0b3e3b5ddffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79c91e209131cea7f5e0.md>)

Recorded evaluation configuration: {"Category":"ARM-based LLMs Agent","setup":"modified (5.1.3)","tools":"search only"}. This record does not assert independent reproduction.

### ReARTeR

Accuracy (R): 49.6. Result ID: 699607945698665ec43efdb5.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaac97a0b3e3b5ddffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76971e209131cea6dfb6.md>)

Recorded evaluation configuration: {"Category":"Traditional RAG"}. This record does not assert independent reproduction.

### Search-o1

Accuracy (R): 49.6. Result ID: 699607945698665ec43efdb6.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaac97a0b3e3b5ddffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76911e209131cea6dca9.md>)

[Implementation](<https://github.com/sunnynexus/Search-o1>)

Recorded evaluation configuration: {"Category":"ARM-based LLMs Agent"}. This record does not assert independent reproduction.

### Search-R1

Accuracy (R): 47.2. Result ID: 699607945698665ec43efdb7.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaac97a0b3e3b5ddffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a651e209131cea82e7b.md>)

Recorded evaluation configuration: {"Category":"ARM-based LLMs Agent"}. This record does not assert independent reproduction.

### LLaDA

Accuracy (R): 46.4. Result ID: 699607945698665ec43efdbb.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaac97a0b3e3b5ddffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c3e1e209131cea8d1d9.md>)

Recorded evaluation configuration: {"Category":"dLLMs Agent","paradigm":"ReAct","acceleration":"Fast-dLLM"}. This record does not assert independent reproduction.

### CR-Planner

Accuracy (R): 35.2. Result ID: 699607945698665ec43efdb4.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaac97a0b3e3b5ddffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75021e209131cea65340.md>)

Recorded evaluation configuration: {"Category":"Traditional RAG"}. This record does not assert independent reproduction.

### IRCoT

Accuracy (R): 32. Result ID: 699607945698665ec43efdb2.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaac97a0b3e3b5ddffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fd81e209131cea4791d.md>)

[Implementation](<https://github.com/stonybrooknlp/ircot>)

Recorded evaluation configuration: {"Category":"Traditional RAG"}. This record does not assert independent reproduction.

### Iter-RetGen

Accuracy (R): 26.4. Result ID: 699607945698665ec43efdb3.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaac97a0b3e3b5ddffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f21e209131cea4e48a.md>)

Recorded evaluation configuration: {"Category":"Traditional RAG"}. This record does not assert independent reproduction.

### Adaptive-RAG

Accuracy (R): 21.6. Result ID: 699607945698665ec43efdb1.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaac97a0b3e3b5ddffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70cb1e209131cea4d27b.md>)

Recorded evaluation configuration: {"Category":"Traditional RAG"}. This record does not assert independent reproduction.

### SuRe

Accuracy (R): 17.6. Result ID: 699607945698665ec43efdaf.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaac97a0b3e3b5ddffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72f81e209131cea59a72.md>)

Recorded evaluation configuration: {"Category":"Traditional RAG"}. This record does not assert independent reproduction.

### Selective-Context

Accuracy (R): 15.2. Result ID: 699607945698665ec43efdb0.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaac97a0b3e3b5ddffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70d81e209131cea4d9ef.md>)

Recorded evaluation configuration: {"Category":"Traditional RAG"}. This record does not assert independent reproduction.

### Dream

Accuracy (R): 12. Result ID: 699607945698665ec43efdba.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaac97a0b3e3b5ddffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ad41e209131cea8563c.md>)

Recorded evaluation configuration: {"Category":"dLLMs Agent","paradigm":"ReAct","acceleration":"Fast-dLLM"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
