# Multi-Hop Question Answering on Bamboogle (EM, F1aware) Source: [Multi-Hop Question Answering on Bamboogle (EM, F1aware)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:41:39.011Z Evaluation of model performance on the Bamboogle dataset for Multi-Hop Question Answering, reporting Exact Match (EM) and F1aware metrics. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Multi-Hop Question Answering | | Dataset (including any stated split) | Bamboogle | | Metric | EM | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [EM](): Higher is better; unit: PERCENT. - [F1aware](): Higher is better; unit: PERCENT. ## Recorded results | Method | EM | Result date | Report paper | | --- | --- | --- | --- | | Search-R1 | 42.4 | Not recorded | 6944dc29423ea42265729cf9 | | ADASEARCH | 42.4 | Not recorded | 6944dc29423ea42265729cf9 | | IKEA | 40.8 | Not recorded | 6944dc29423ea42265729cf9 | | Naive Shaping | 36.8 | Not recorded | 6944dc29423ea42265729cf9 | | CoT | 35.2 | Not recorded | 6944dc29423ea42265729cf9 | | RL w/o search | 34.4 | Not recorded | 6944dc29423ea42265729cf9 | | Awareness Shaping | 32 | Not recorded | 6944dc29423ea42265729cf9 | | Search-R1 | 29.6 | Not recorded | 6944dc29423ea42265729cf9 | | ADASEARCH | 28 | Not recorded | 6944dc29423ea42265729cf9 | | Naive Shaping | 24.8 | Not recorded | 6944dc29423ea42265729cf9 | | CoT | 24 | Not recorded | 6944dc29423ea42265729cf9 | | RL w/o search | 23.2 | Not recorded | 6944dc29423ea42265729cf9 | | IKEA | 23.2 | Not recorded | 6944dc29423ea42265729cf9 | | Awareness Shaping | 22.4 | Not recorded | 6944dc29423ea42265729cf9 | | RAG | 12.8 | Not recorded | 6944dc29423ea42265729cf9 | | Direct Answer | 8.8 | Not recorded | 6944dc29423ea42265729cf9 | | RAG | 8 | Not recorded | 6944dc29423ea42265729cf9 | | Direct Answer | 5.6 | Not recorded | 6944dc29423ea42265729cf9 | ### Search-R1 EM: 42.4. Result ID: 6996b9bb5698665ec4047228. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.2-3B-Instruct","Category":"Outcome RL Baselines"}. This record does not assert independent reproduction. ### ADASEARCH EM: 42.4. Result ID: 6996b9bb5698665ec404722c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.2-3B-Instruct","Category":"Paper Method"}. This record does not assert independent reproduction. ### IKEA EM: 40.8. Result ID: 6996b9bb5698665ec404722b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.2-3B-Instruct","Category":"Reward-Shaping Baselines"}. This record does not assert independent reproduction. ### Naive Shaping EM: 36.8. Result ID: 6996b9bb5698665ec4047229. [Reporting paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.2-3B-Instruct","Category":"Reward-Shaping Baselines"}. This record does not assert independent reproduction. ### CoT EM: 35.2. Result ID: 6996b9bb5698665ec4047225. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.2-3B-Instruct","Category":"Prompting Baselines"}. This record does not assert independent reproduction. ### RL w/o search EM: 34.4. Result ID: 6996b9bb5698665ec4047227. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.2-3B-Instruct","Category":"Outcome RL Baselines"}. This record does not assert independent reproduction. ### Awareness Shaping EM: 32. Result ID: 6996b9bb5698665ec404722a. [Reporting paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.2-3B-Instruct","Category":"Reward-Shaping Baselines"}. This record does not assert independent reproduction. ### Search-R1 EM: 29.6. Result ID: 6996b9bb5698665ec404721f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-3B-Instruct","Category":"Outcome RL Baselines"}. This record does not assert independent reproduction. ### ADASEARCH EM: 28. Result ID: 6996b9bb5698665ec4047223. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-3B-Instruct","Category":"Paper Method"}. This record does not assert independent reproduction. ### Naive Shaping EM: 24.8. Result ID: 6996b9bb5698665ec4047220. [Reporting paper]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-3B-Instruct","Category":"Reward-Shaping Baselines"}. This record does not assert independent reproduction. ### CoT EM: 24. Result ID: 6996b9bb5698665ec404721c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-3B-Instruct","Category":"Prompting Baselines"}. This record does not assert independent reproduction. ### RL w/o search EM: 23.2. Result ID: 6996b9bb5698665ec404721e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-3B-Instruct","Category":"Outcome RL Baselines"}. This record does not assert independent reproduction. ### IKEA EM: 23.2. Result ID: 6996b9bb5698665ec4047222. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-3B-Instruct","Category":"Reward-Shaping Baselines"}. This record does not assert independent reproduction. ### Awareness Shaping EM: 22.4. Result ID: 6996b9bb5698665ec4047221. [Reporting paper]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-3B-Instruct","Category":"Reward-Shaping Baselines"}. This record does not assert independent reproduction. ### RAG EM: 12.8. Result ID: 6996b9bb5698665ec4047226. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Base Model":"Llama-3.2-3B-Instruct","Category":"Prompting Baselines"}. This record does not assert independent reproduction. ### Direct Answer EM: 8.8. Result ID: 6996b9bb5698665ec4047224. [Reporting paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.2-3B-Instruct","Category":"Prompting Baselines"}. This record does not assert independent reproduction. ### RAG EM: 8. Result ID: 6996b9bb5698665ec404721d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-3B-Instruct","Category":"Prompting Baselines"}. This record does not assert independent reproduction. ### Direct Answer EM: 5.6. Result ID: 6996b9bb5698665ec404721b. [Reporting paper]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-3B-Instruct","Category":"Prompting Baselines"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.