# Multi-Hop Question Answering on HotpotQA (Accuracy) Source: [Multi-Hop Question Answering on HotpotQA (Accuracy)]() Collection index: [llms.txt]() Data updated: 2026-03-11T06:47:12.188Z Evaluation of model performance on the HotpotQA dataset for multi-hop question answering, specifically measured using the Accuracy metric. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Multi-Hop Question Answering | | Dataset (including any stated split) | HotpotQA | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 30 of 30 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | SkillOrchestra+ | 44.2 | Not recorded | 699d30a46017c4460ffab56f | | HCAPO (Ours) | 42.1 | Not recorded | 69b0f6e52d603e6de3e45b4e | | GiGPO | 41.6 | Not recorded | 69b0f6e52d603e6de3e45b4e | | SkillOrchestra | 39 | Not recorded | 699d30a46017c4460ffab56f | | HCAPO (Ours) | 38.6 | Not recorded | 69b0f6e52d603e6de3e45b4e | | StepSearch | 38.6 | Not recorded | 69b0f6e52d603e6de3e45b4e | | Search-R1 | 37 | Not recorded | 69b0f6e52d603e6de3e45b4e | | GiGPO | 36.9 | Not recorded | 69b0f6e52d603e6de3e45b4e | | Router-R1 | 35.2 | Not recorded | 699d30a46017c4460ffab56f | | ZeroSearch | 34.6 | Not recorded | 69b0f6e52d603e6de3e45b4e | | StepSearch | 34.5 | Not recorded | 69b0f6e52d603e6de3e45b4e | | Search-R1 | 32.4 | Not recorded | 69b0f6e52d603e6de3e45b4e | | Largest LLM | 27.8 | Not recorded | 699d30a46017c4460ffab56f | | ZeroSearch | 27.4 | Not recorded | 69b0f6e52d603e6de3e45b4e | | Prompt LLM | 26.8 | Not recorded | 699d30a46017c4460ffab56f | | RouterDC | 24.4 | Not recorded | 699d30a46017c4460ffab56f | | R1-Instruct | 23.7 | Not recorded | 69b0f6e52d603e6de3e45b4e | | Search-R1 | 23.6 | Not recorded | 699d30a46017c4460ffab56f | | GraphRouter | 23.4 | Not recorded | 699d30a46017c4460ffab56f | | FrugalGPT | 23.4 | Not recorded | 699d30a46017c4460ffab56f | | KNN Router | 22.4 | Not recorded | 699d30a46017c4460ffab56f | | RAG | 21.6 | Not recorded | 699d30a46017c4460ffab56f | | BERT Router | 21.6 | Not recorded | 699d30a46017c4460ffab56f | | R1-Instruct | 20.8 | Not recorded | 69b0f6e52d603e6de3e45b4e | | Prompt LLM+ | 20.6 | Not recorded | 699d30a46017c4460ffab56f | | SFT | 19.8 | Not recorded | 699d30a46017c4460ffab56f | | MLP Router | 19.8 | Not recorded | 699d30a46017c4460ffab56f | | CoT | 16.8 | Not recorded | 699d30a46017c4460ffab56f | | KNN Router+ | 15.4 | Not recorded | 699d30a46017c4460ffab56f | | Vanilla | 14 | Not recorded | 699d30a46017c4460ffab56f | ### SkillOrchestra+ Accuracy: 44.2. Result ID: 699e525c5698665ec411c0fa. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Routing Strategy":"Skill-based Routing","Orchestrator Configuration":"Best/Multiple"}. This record does not assert independent reproduction. ### HCAPO (Ours) Accuracy: 42.1. Result ID: 69b10fd66dbb7075b95ad453. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"RL Training","Base Model":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction. ### GiGPO Accuracy: 41.6. Result ID: 69b10fd66dbb7075b95ad452. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"RL Training","Base Model":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction. ### SkillOrchestra Accuracy: 39. Result ID: 699e525c5698665ec411c0f9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Routing Strategy":"Skill-based Routing","Orchestrator Configuration":"Single"}. This record does not assert independent reproduction. ### HCAPO (Ours) Accuracy: 38.6. Result ID: 69b10fd66dbb7075b95ad44d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"RL Training","Base Model":"Qwen2.5-3B-Instruct"}. This record does not assert independent reproduction. ### StepSearch Accuracy: 38.6. Result ID: 69b10fd66dbb7075b95ad451. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"RL Training","Base Model":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction. ### Search-R1 Accuracy: 37. Result ID: 69b10fd66dbb7075b95ad44f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"RL Training","Base Model":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction. ### GiGPO Accuracy: 36.9. Result ID: 69b10fd66dbb7075b95ad44c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"RL Training","Base Model":"Qwen2.5-3B-Instruct"}. This record does not assert independent reproduction. ### Router-R1 Accuracy: 35.2. Result ID: 699e525c5698665ec411c0f8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Routing Strategy":"RL-based Routing"}. This record does not assert independent reproduction. ### ZeroSearch Accuracy: 34.6. Result ID: 69b10fd66dbb7075b95ad450. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"RL Training","Base Model":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction. ### StepSearch Accuracy: 34.5. Result ID: 69b10fd66dbb7075b95ad44b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"RL Training","Base Model":"Qwen2.5-3B-Instruct"}. This record does not assert independent reproduction. ### Search-R1 Accuracy: 32.4. Result ID: 69b10fd66dbb7075b95ad449. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"RL Training","Base Model":"Qwen2.5-3B-Instruct"}. This record does not assert independent reproduction. ### Largest LLM Accuracy: 27.8. Result ID: 699e525c5698665ec411c0ee. [Reporting paper]() Recorded evaluation configuration: {"Routing Strategy":"Heuristic & Discriminative Routing"}. This record does not assert independent reproduction. ### ZeroSearch Accuracy: 27.4. Result ID: 69b10fd66dbb7075b95ad44a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"RL Training","Base Model":"Qwen2.5-3B-Instruct"}. This record does not assert independent reproduction. ### Prompt LLM Accuracy: 26.8. Result ID: 699e525c5698665ec411c0ef. [Reporting paper]() Recorded evaluation configuration: {"Routing Strategy":"Heuristic & Discriminative Routing"}. This record does not assert independent reproduction. ### RouterDC Accuracy: 24.4. Result ID: 699e525c5698665ec411c0f5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Routing Strategy":"Heuristic & Discriminative Routing"}. This record does not assert independent reproduction. ### R1-Instruct Accuracy: 23.7. Result ID: 69b10fd66dbb7075b95ad448. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"RL Training","Base Model":"Qwen2.5-3B-Instruct"}. This record does not assert independent reproduction. ### Search-R1 Accuracy: 23.6. Result ID: 699e525c5698665ec411c0ed. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Routing Strategy":"No Routing"}. This record does not assert independent reproduction. ### GraphRouter Accuracy: 23.4. Result ID: 699e525c5698665ec411c0f6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Routing Strategy":"Heuristic & Discriminative Routing"}. This record does not assert independent reproduction. ### FrugalGPT Accuracy: 23.4. Result ID: 699e525c5698665ec411c0f7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Routing Strategy":"Heuristic & Discriminative Routing"}. This record does not assert independent reproduction. ### KNN Router Accuracy: 22.4. Result ID: 699e525c5698665ec411c0f1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Routing Strategy":"Heuristic & Discriminative Routing"}. This record does not assert independent reproduction. ### RAG Accuracy: 21.6. Result ID: 699e525c5698665ec411c0eb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Routing Strategy":"No Routing"}. This record does not assert independent reproduction. ### BERT Router Accuracy: 21.6. Result ID: 699e525c5698665ec411c0f4. [Reporting paper]() Recorded evaluation configuration: {"Routing Strategy":"Heuristic & Discriminative Routing"}. This record does not assert independent reproduction. ### R1-Instruct Accuracy: 20.8. Result ID: 69b10fd66dbb7075b95ad44e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"RL Training","Base Model":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction. ### Prompt LLM+ Accuracy: 20.6. Result ID: 699e525c5698665ec411c0f0. [Reporting paper]() Recorded evaluation configuration: {"Routing Strategy":"Heuristic & Discriminative Routing","Turn Protocol":"multi turn"}. This record does not assert independent reproduction. ### SFT Accuracy: 19.8. Result ID: 699e525c5698665ec411c0ea. [Reporting paper]() Recorded evaluation configuration: {"Routing Strategy":"No Routing"}. This record does not assert independent reproduction. ### MLP Router Accuracy: 19.8. Result ID: 699e525c5698665ec411c0f3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Routing Strategy":"Heuristic & Discriminative Routing"}. This record does not assert independent reproduction. ### CoT Accuracy: 16.8. Result ID: 699e525c5698665ec411c0ec. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Routing Strategy":"No Routing"}. This record does not assert independent reproduction. ### KNN Router+ Accuracy: 15.4. Result ID: 699e525c5698665ec411c0f2. [Reporting paper]() Recorded evaluation configuration: {"Routing Strategy":"Heuristic & Discriminative Routing","Turn Protocol":"multi turn"}. This record does not assert independent reproduction. ### Vanilla Accuracy: 14. Result ID: 699e525c5698665ec411c0e9. [Reporting paper]() Recorded evaluation configuration: {"Routing Strategy":"No Routing"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.