# Multi-hop Question Answering on HotpotQA (official evaluation) Source: [Multi-hop Question Answering on HotpotQA (official evaluation)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:41:42.926Z Evaluation of model performance on the official evaluation set of the HotpotQA dataset for multi-hop question answering, focusing on Exact Match (EM) accuracy. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Multi-hop Question Answering | | Dataset (including any stated split) | HotpotQA (official evaluation) | | Metric | EM Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 17 of 17 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [EM Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | EM Accuracy | Result date | Report paper | | --- | --- | --- | --- | | M3PO | 33.2 | Not recorded | 692e7315d6b0dd3342932746 | | HRPO | 31.6 | Not recorded | 692e7315d6b0dd3342932746 | | GRPO | 30.8 | Not recorded | 692e7315d6b0dd3342932746 | | PPO | 30.4 | Not recorded | 692e7315d6b0dd3342932746 | | RAG | 29.9 | Not recorded | 692e7315d6b0dd3342932746 | | M3PO | 28.7 | Not recorded | 692e7315d6b0dd3342932746 | | HRPO | 27.3 | Not recorded | 692e7315d6b0dd3342932746 | | PPO | 25.6 | Not recorded | 692e7315d6b0dd3342932746 | | RAG | 25.5 | Not recorded | 692e7315d6b0dd3342932746 | | RAG | 22.8 | Not recorded | 692e7315d6b0dd3342932746 | | GRPO | 20.2 | Not recorded | 692e7315d6b0dd3342932746 | | Search-o1 | 18.7 | Not recorded | 692e7315d6b0dd3342932746 | | SFT | 18.6 | Not recorded | 692e7315d6b0dd3342932746 | | QA | 18.3 | Not recorded | 692e7315d6b0dd3342932746 | | IRCoT | 13.3 | Not recorded | 692e7315d6b0dd3342932746 | | SFT | 12.9 | Not recorded | 692e7315d6b0dd3342932746 | | CoT | 9.2 | Not recorded | 692e7315d6b0dd3342932746 | ### M3PO EM Accuracy: 33.2. Result ID: 699633a25698665ec475d5df. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B-Instruct","Strategy":"Multi-Path Perception Policy Optimization","Context Retrieval":"Top-3 documents"}. This record does not assert independent reproduction. ### HRPO EM Accuracy: 31.6. Result ID: 699633a25698665ec475d5de. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B-Instruct","Strategy":"Hybrid Reasoning Policy Optimization","Context Retrieval":"Top-3 documents"}. This record does not assert independent reproduction. ### GRPO EM Accuracy: 30.8. Result ID: 699633a25698665ec475d5dd. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B-Instruct","Strategy":"GRPO","Context Retrieval":"Top-3 documents"}. This record does not assert independent reproduction. ### PPO EM Accuracy: 30.4. Result ID: 699633a25698665ec475d5dc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B-Instruct","Strategy":"PPO","Context Retrieval":"Top-3 documents"}. This record does not assert independent reproduction. ### RAG EM Accuracy: 29.9. Result ID: 699633a25698665ec475d5d3. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct","Strategy":"Retrieval-Augmented Generation","Context Retrieval":"Top-3 documents"}. This record does not assert independent reproduction. ### M3PO EM Accuracy: 28.7. Result ID: 699633a25698665ec475d5d9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-1.5B-Instruct","Strategy":"Multi-Path Perception Policy Optimization","Context Retrieval":"Top-3 documents"}. This record does not assert independent reproduction. ### HRPO EM Accuracy: 27.3. Result ID: 699633a25698665ec475d5d8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-1.5B-Instruct","Strategy":"Hybrid Reasoning Policy Optimization","Context Retrieval":"Top-3 documents"}. This record does not assert independent reproduction. ### PPO EM Accuracy: 25.6. Result ID: 699633a25698665ec475d5d6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-1.5B-Instruct","Strategy":"PPO","Context Retrieval":"Top-3 documents"}. This record does not assert independent reproduction. ### RAG EM Accuracy: 25.5. Result ID: 699633a25698665ec475d5db. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B-Instruct","Strategy":"Retrieval-Augmented Generation","Context Retrieval":"Top-3 documents"}. This record does not assert independent reproduction. ### RAG EM Accuracy: 22.8. Result ID: 699633a25698665ec475d5d5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-1.5B-Instruct","Strategy":"Retrieval-Augmented Generation","Context Retrieval":"Top-3 documents"}. This record does not assert independent reproduction. ### GRPO EM Accuracy: 20.2. Result ID: 699633a25698665ec475d5d7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-1.5B-Instruct","Strategy":"GRPO","Context Retrieval":"Top-3 documents"}. This record does not assert independent reproduction. ### Search-o1 EM Accuracy: 18.7. Result ID: 699633a25698665ec475d5d2. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct","Strategy":"Search-o1","Context Retrieval":"Top-3 documents"}. This record does not assert independent reproduction. ### SFT EM Accuracy: 18.6. Result ID: 699633a25698665ec475d5da. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B-Instruct","Strategy":"Supervised Fine-Tuning","Context Retrieval":"Top-3 documents"}. This record does not assert independent reproduction. ### QA EM Accuracy: 18.3. Result ID: 699633a25698665ec475d5cf. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct","Strategy":"Direct inference","Context Retrieval":"Top-3 documents"}. This record does not assert independent reproduction. ### IRCoT EM Accuracy: 13.3. Result ID: 699633a25698665ec475d5d1. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct","Strategy":"Interleaved retrieval with CoT","Context Retrieval":"Top-3 documents"}. This record does not assert independent reproduction. ### SFT EM Accuracy: 12.9. Result ID: 699633a25698665ec475d5d4. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-1.5B-Instruct","Strategy":"Supervised Fine-Tuning","Context Retrieval":"Top-3 documents"}. This record does not assert independent reproduction. ### CoT EM Accuracy: 9.2. Result ID: 699633a25698665ec475d5d0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct","Strategy":"Chain-of-Thought","Context Retrieval":"Top-3 documents"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.