# Multi-hop Question Answering on MuSiQue (F1, ROUGHL, EM) Source: [Multi-hop Question Answering on MuSiQue (F1, ROUGHL, EM)]() Collection index: [llms.txt]() Data updated: 2026-05-13T10:18:07.477Z Evaluation of model performance on the MuSiQue dataset for Multi-hop Question Answering, measured using F1 score, ROUGHL, and Exact Match (EM). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Multi-hop Question Answering | | Dataset (including any stated split) | MuSiQue | | Metric | F1 Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 36 of 36 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [F1 Score](): Higher is better; unit: PERCENT. - [ROUGHL Score](): Higher is better; unit: PERCENT. - [Exact Match (EM)](): Higher is better; unit: PERCENT. ## Recorded results | Method | F1 Score | Result date | Report paper | | --- | --- | --- | --- | | DIRECT QUERY | 72 | Not recorded | 68fa758c1e209131cea68880 | | CONFUSIONPROMPT | 68 | Not recorded | 68fa758c1e209131cea68880 | | DIRECT QUERY | 66 | Not recorded | 68fa758c1e209131cea68880 | | CONFUSIONPROMPT | 63 | Not recorded | 68fa758c1e209131cea68880 | | CONFUSIONPROMPT | 61 | Not recorded | 68fa758c1e209131cea68880 | | DIRECT QUERY | 60 | Not recorded | 68fa758c1e209131cea68880 | | SAGE | 53.1 | Not recorded | 6a0405a8dbc836b87d82765f | | SAGE | 52.6 | Not recorded | 6a0405a8dbc836b87d82765f | | SAGE | 52.3 | Not recorded | 6a0405a8dbc836b87d82765f | | GFM-RAG + IRCoT | 49.2 | Not recorded | 6a0405a8dbc836b87d82765f | | LLAMA2-7B | 48 | Not recorded | 68fa758c1e209131cea68880 | | SAGE | 47.3 | Not recorded | 6a0405a8dbc836b87d82765f | | VICUNA-13B | 42 | Not recorded | 68fa758c1e209131cea68880 | | PropRAG | 41.3 | Not recorded | 6a0405a8dbc836b87d82765f | | HippoRAG 2 | 40.5 | Not recorded | 6a0405a8dbc836b87d82765f | | GFM-RAG | 40.4 | Not recorded | 6a0405a8dbc836b87d82765f | | SubgraphRAG | 39.2 | Not recorded | 6a0405a8dbc836b87d82765f | | HippoRAG + IRCoT | 33.3 | Not recorded | 6a0405a8dbc836b87d82765f | | ColBERTv2 + IRCoT | 30.5 | Not recorded | 6a0405a8dbc836b87d82765f | | HippoRAG | 29.8 | Not recorded | 6a0405a8dbc836b87d82765f | | GraphRAG | 29.5 | Not recorded | 6a0405a8dbc836b87d82765f | | RAPTOR | 28.9 | Not recorded | 6a0405a8dbc836b87d82765f | | FLARE | 28.4 | Not recorded | 6a0405a8dbc836b87d82765f | | LightRAG | 27.5 | Not recorded | 6a0405a8dbc836b87d82765f | | ColBERTv2 | 26.4 | Not recorded | 6a0405a8dbc836b87d82765f | | G-Retriever | 25.9 | Not recorded | 6a0405a8dbc836b87d82765f | | Adaptive-RAG | 25.6 | Not recorded | 6a0405a8dbc836b87d82765f | | GTR | 25.2 | Not recorded | 6a0405a8dbc836b87d82765f | | BM25 | 23.6 | Not recorded | 6a0405a8dbc836b87d82765f | | Contriever | 21.6 | Not recorded | 6a0405a8dbc836b87d82765f | | PARAPHRASER | 8 | Not recorded | 68fa758c1e209131cea68880 | | PARAPHRASER | 7 | Not recorded | 68fa758c1e209131cea68880 | | PARAPHRASER | 6 | Not recorded | 68fa758c1e209131cea68880 | | TEXT2TEXT | 3 | Not recorded | 68fa758c1e209131cea68880 | | TEXT2TEXT | 2 | Not recorded | 68fa758c1e209131cea68880 | | TEXT2TEXT | 2 | Not recorded | 68fa758c1e209131cea68880 | ### DIRECT QUERY F1 Score: 72. Result ID: 69d837cb47f34ce924c000b7. [Reporting paper]() Recorded evaluation configuration: {"PRIVATE":"NO","Backbone":"GPT-4O"}. This record does not assert independent reproduction. ### CONFUSIONPROMPT F1 Score: 68. Result ID: 69d837cb47f34ce924c000ba. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"PRIVATE":"YES","Backbone":"GPT-4O"}. This record does not assert independent reproduction. ### DIRECT QUERY F1 Score: 66. Result ID: 69d837cb47f34ce924c000b6. [Reporting paper]() Recorded evaluation configuration: {"PRIVATE":"NO","Backbone":"GPT-4-TURBO"}. This record does not assert independent reproduction. ### CONFUSIONPROMPT F1 Score: 63. Result ID: 69d837cb47f34ce924c000b9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"PRIVATE":"YES","Backbone":"GPT-4-TURBO"}. This record does not assert independent reproduction. ### CONFUSIONPROMPT F1 Score: 61. Result ID: 69d837cb47f34ce924c000b8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"PRIVATE":"YES","Backbone":"GPT-3.5-TURBO"}. This record does not assert independent reproduction. ### DIRECT QUERY F1 Score: 60. Result ID: 69d837cb47f34ce924c000b5. [Reporting paper]() Recorded evaluation configuration: {"PRIVATE":"NO","Backbone":"GPT-3.5-TURBO"}. This record does not assert independent reproduction. ### SAGE F1 Score: 53.1. Result ID: 6a044fc747f34ce924eac4be. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"variant":"+2 round","Avg. Rank":"2.5"}. This record does not assert independent reproduction. ### SAGE F1 Score: 52.6. Result ID: 6a044fc747f34ce924eac4bf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"variant":"+ IRCoT","Avg. Rank":"3.3"}. This record does not assert independent reproduction. ### SAGE F1 Score: 52.3. Result ID: 6a044fc747f34ce924eac4bd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"variant":"+1 round","Avg. Rank":"4.2"}. This record does not assert independent reproduction. ### GFM-RAG + IRCoT F1 Score: 49.2. Result ID: 6a044fc747f34ce924eac4bb. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Avg. Rank":"3.7"}. This record does not assert independent reproduction. ### LLAMA2-7B F1 Score: 48. Result ID: 69d837cb47f34ce924c000ad. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"PRIVATE":"YES"}. This record does not assert independent reproduction. ### SAGE F1 Score: 47.3. Result ID: 6a044fc747f34ce924eac4bc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Avg. Rank":"7.5"}. This record does not assert independent reproduction. ### VICUNA-13B F1 Score: 42. Result ID: 69d837cb47f34ce924c000ae. [Reporting paper]() Recorded evaluation configuration: {"PRIVATE":"YES"}. This record does not assert independent reproduction. ### PropRAG F1 Score: 41.3. Result ID: 6a044fc747f34ce924eac4b5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Avg. Rank":"3.8"}. This record does not assert independent reproduction. ### HippoRAG 2 F1 Score: 40.5. Result ID: 6a044fc747f34ce924eac4b3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Avg. Rank":"4.7"}. This record does not assert independent reproduction. ### GFM-RAG F1 Score: 40.4. Result ID: 6a044fc747f34ce924eac4b6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Avg. Rank":"7.8"}. This record does not assert independent reproduction. ### SubgraphRAG F1 Score: 39.2. Result ID: 6a044fc747f34ce924eac4b4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Avg. Rank":"7.5"}. This record does not assert independent reproduction. ### HippoRAG + IRCoT F1 Score: 33.3. Result ID: 6a044fc747f34ce924eac4ba. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Avg. Rank":"11.3"}. This record does not assert independent reproduction. ### ColBERTv2 + IRCoT F1 Score: 30.5. Result ID: 6a044fc747f34ce924eac4b9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Avg. Rank":"14.4"}. This record does not assert independent reproduction. ### HippoRAG F1 Score: 29.8. Result ID: 6a044fc747f34ce924eac4b2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Avg. Rank":"13.8"}. This record does not assert independent reproduction. ### GraphRAG F1 Score: 29.5. Result ID: 6a044fc747f34ce924eac4af. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Avg. Rank":"18.0"}. This record does not assert independent reproduction. ### RAPTOR F1 Score: 28.9. Result ID: 6a044fc747f34ce924eac4ae. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Avg. Rank":"15.8"}. This record does not assert independent reproduction. ### FLARE F1 Score: 28.4. Result ID: 6a044fc747f34ce924eac4b7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Avg. Rank":"12.7"}. This record does not assert independent reproduction. ### LightRAG F1 Score: 27.5. Result ID: 6a044fc747f34ce924eac4b1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Avg. Rank":"16.7"}. This record does not assert independent reproduction. ### ColBERTv2 F1 Score: 26.4. Result ID: 6a044fc747f34ce924eac4ad. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Avg. Rank":"17.3"}. This record does not assert independent reproduction. ### G-Retriever F1 Score: 25.9. Result ID: 6a044fc747f34ce924eac4b0. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Avg. Rank":"18.2"}. This record does not assert independent reproduction. ### Adaptive-RAG F1 Score: 25.6. Result ID: 6a044fc747f34ce924eac4b8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Avg. Rank":"14.3"}. This record does not assert independent reproduction. ### GTR F1 Score: 25.2. Result ID: 6a044fc747f34ce924eac4ac. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Avg. Rank":"19.7"}. This record does not assert independent reproduction. ### BM25 F1 Score: 23.6. Result ID: 6a044fc747f34ce924eac4aa. [Reporting paper]() Recorded evaluation configuration: {"Avg. Rank":"15.5"}. This record does not assert independent reproduction. ### Contriever F1 Score: 21.6. Result ID: 6a044fc747f34ce924eac4ab. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Avg. Rank":"20.5"}. This record does not assert independent reproduction. ### PARAPHRASER F1 Score: 8. Result ID: 69d837cb47f34ce924c000b2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"PRIVATE":"YES","Backbone":"GPT-3.5-TURBO"}. This record does not assert independent reproduction. ### PARAPHRASER F1 Score: 7. Result ID: 69d837cb47f34ce924c000b4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"PRIVATE":"YES","Backbone":"GPT-4O"}. This record does not assert independent reproduction. ### PARAPHRASER F1 Score: 6. Result ID: 69d837cb47f34ce924c000b3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"PRIVATE":"YES","Backbone":"GPT-4-TURBO"}. This record does not assert independent reproduction. ### TEXT2TEXT F1 Score: 3. Result ID: 69d837cb47f34ce924c000b0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"PRIVATE":"YES","Backbone":"GPT-4-TURBO"}. This record does not assert independent reproduction. ### TEXT2TEXT F1 Score: 2. Result ID: 69d837cb47f34ce924c000af. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"PRIVATE":"YES","Backbone":"GPT-3.5-TURBO"}. This record does not assert independent reproduction. ### TEXT2TEXT F1 Score: 2. Result ID: 69d837cb47f34ce924c000b1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"PRIVATE":"YES","Backbone":"GPT-4O"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.