# General Question Answering on TriviaQA (EM, F1aware) Source: [General Question Answering on TriviaQA (EM, F1aware)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:41:38.818Z Evaluation of model performance on the TriviaQA dataset for General Question Answering, reporting Exact Match (EM) and F1aware scores. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | General Question Answering | | Dataset (including any stated split) | TriviaQA | | Metric | EM | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [EM](): Higher is better; unit: PERCENT. - [F1aware](): Higher is better; unit: PERCENT. ## Recorded results | Method | EM | Result date | Report paper | | --- | --- | --- | --- | | Search-R1 | 64.4 | Not recorded | 6944dc29423ea42265729cf9 | | ADASEARCH | 62.9 | Not recorded | 6944dc29423ea42265729cf9 | | IKEA | 62 | Not recorded | 6944dc29423ea42265729cf9 | | Awareness Shaping | 61.5 | Not recorded | 6944dc29423ea42265729cf9 | | Search-R1 | 60.1 | Not recorded | 6944dc29423ea42265729cf9 | | Naive Shaping | 59.7 | Not recorded | 6944dc29423ea42265729cf9 | | IKEA | 59.5 | Not recorded | 6944dc29423ea42265729cf9 | | ADASEARCH | 56.8 | Not recorded | 6944dc29423ea42265729cf9 | | Awareness Shaping | 56.1 | Not recorded | 6944dc29423ea42265729cf9 | | Naive Shaping | 54.8 | Not recorded | 6944dc29423ea42265729cf9 | | RL w/o search | 54.6 | Not recorded | 6944dc29423ea42265729cf9 | | RAG | 53 | Not recorded | 6944dc29423ea42265729cf9 | | RAG | 52.7 | Not recorded | 6944dc29423ea42265729cf9 | | CoT | 45.6 | Not recorded | 6944dc29423ea42265729cf9 | | RL w/o search | 44.9 | Not recorded | 6944dc29423ea42265729cf9 | | Direct Answer | 42.3 | Not recorded | 6944dc29423ea42265729cf9 | | CoT | 38.2 | Not recorded | 6944dc29423ea42265729cf9 | | Direct Answer | 24.1 | Not recorded | 6944dc29423ea42265729cf9 | ### Search-R1 EM: 64.4. Result ID: 6996b9bb5698665ec40471ce. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.2-3B-Instruct","Category":"Outcome RL Baselines"}. This record does not assert independent reproduction. ### ADASEARCH EM: 62.9. Result ID: 6996b9bb5698665ec40471d2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.2-3B-Instruct","Category":"Paper Method"}. This record does not assert independent reproduction. ### IKEA EM: 62. Result ID: 6996b9bb5698665ec40471d1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.2-3B-Instruct","Category":"Reward-Shaping Baselines"}. This record does not assert independent reproduction. ### Awareness Shaping EM: 61.5. Result ID: 6996b9bb5698665ec40471d0. [Reporting paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.2-3B-Instruct","Category":"Reward-Shaping Baselines"}. This record does not assert independent reproduction. ### Search-R1 EM: 60.1. Result ID: 6996b9bb5698665ec40471c5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-3B-Instruct","Category":"Outcome RL Baselines"}. This record does not assert independent reproduction. ### Naive Shaping EM: 59.7. Result ID: 6996b9bb5698665ec40471cf. [Reporting paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.2-3B-Instruct","Category":"Reward-Shaping Baselines"}. This record does not assert independent reproduction. ### IKEA EM: 59.5. Result ID: 6996b9bb5698665ec40471c8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-3B-Instruct","Category":"Reward-Shaping Baselines"}. This record does not assert independent reproduction. ### ADASEARCH EM: 56.8. Result ID: 6996b9bb5698665ec40471c9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-3B-Instruct","Category":"Paper Method"}. This record does not assert independent reproduction. ### Awareness Shaping EM: 56.1. Result ID: 6996b9bb5698665ec40471c7. [Reporting paper]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-3B-Instruct","Category":"Reward-Shaping Baselines"}. This record does not assert independent reproduction. ### Naive Shaping EM: 54.8. Result ID: 6996b9bb5698665ec40471c6. [Reporting paper]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-3B-Instruct","Category":"Reward-Shaping Baselines"}. This record does not assert independent reproduction. ### RL w/o search EM: 54.6. Result ID: 6996b9bb5698665ec40471cd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.2-3B-Instruct","Category":"Outcome RL Baselines"}. This record does not assert independent reproduction. ### RAG EM: 53. Result ID: 6996b9bb5698665ec40471cc. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Base Model":"Llama-3.2-3B-Instruct","Category":"Prompting Baselines"}. This record does not assert independent reproduction. ### RAG EM: 52.7. Result ID: 6996b9bb5698665ec40471c3. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-3B-Instruct","Category":"Prompting Baselines"}. This record does not assert independent reproduction. ### CoT EM: 45.6. Result ID: 6996b9bb5698665ec40471cb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.2-3B-Instruct","Category":"Prompting Baselines"}. This record does not assert independent reproduction. ### RL w/o search EM: 44.9. Result ID: 6996b9bb5698665ec40471c4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-3B-Instruct","Category":"Outcome RL Baselines"}. This record does not assert independent reproduction. ### Direct Answer EM: 42.3. Result ID: 6996b9bb5698665ec40471ca. [Reporting paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.2-3B-Instruct","Category":"Prompting Baselines"}. This record does not assert independent reproduction. ### CoT EM: 38.2. Result ID: 6996b9bb5698665ec40471c2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-3B-Instruct","Category":"Prompting Baselines"}. This record does not assert independent reproduction. ### Direct Answer EM: 24.1. Result ID: 6996b9bb5698665ec40471c1. [Reporting paper]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-3B-Instruct","Category":"Prompting Baselines"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.