# Open-Domain Question Answering on WebQuestions (WQ) Source: [Open-Domain Question Answering on WebQuestions (WQ)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:42:29.424Z Evaluation of model performance on the WebQuestions (WQ) dataset for Open-Domain Question Answering, measured using Exact Match (EM). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Open-Domain Question Answering | | Dataset (including any stated split) | WebQuestions (WQ) | | Metric | Exact Match (EM) | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 15 of 15 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Exact Match (EM)](): Higher is better; unit: PERCENT. ## Recorded results | Method | Exact Match (EM) | Result date | Report paper | | --- | --- | --- | --- | | RAG | 45.2 | Not recorded | 68fa6dc31e209131cea3bead | | DPR | 42.4 | Not recorded | 68fa6dc31e209131cea3bead | | REALM | 40.7 | Not recorded | 68fa6dc31e209131cea3bead | | QAMAT | 39.4 | Not recorded | 68fa6dc31e209131cea3bead | | RePAQ rerank | 37.6 | Not recorded | 68fa6dc31e209131cea3bead | | T5-11B | 37.2 | Not recorded | 68fa6dc31e209131cea3bead | | EMAT-FKSV | 36.7 | Not recorded | 68fa6dc31e209131cea3bead | | T5-3B | 33.6 | Not recorded | 68fa6dc31e209131cea3bead | | EMAT-SKSV | 33.2 | Not recorded | 68fa6dc31e209131cea3bead | | FiD-base | 32.4 | Not recorded | 68fa6dc31e209131cea3bead | | RePAQ-base | 29.4 | Not recorded | 68fa6dc31e209131cea3bead | | Dense Retriever | 28.9 | Not recorded | 68fa6dc31e209131cea3bead | | T5-large | 27.7 | Not recorded | 68fa6dc31e209131cea3bead | | BART-large | 27.4 | Not recorded | 68fa6dc31e209131cea3bead | | T5-base | 26.6 | Not recorded | 68fa6dc31e209131cea3bead | ### RAG Exact Match (EM): 45.2. Result ID: 698fdacb3a6c314849fc594c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Type":"Retrieval-augmented"}. This record does not assert independent reproduction. ### DPR Exact Match (EM): 42.4. Result ID: 698fdacb3a6c314849fc5949. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Type":"Retrieval-augmented"}. This record does not assert independent reproduction. ### REALM Exact Match (EM): 40.7. Result ID: 698fdacb3a6c314849fc5948. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Type":"Retrieval-augmented"}. This record does not assert independent reproduction. ### QAMAT Exact Match (EM): 39.4. Result ID: 698fdacb3a6c314849fc594a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Type":"Retrieval-augmented"}. This record does not assert independent reproduction. ### RePAQ rerank Exact Match (EM): 37.6. Result ID: 698fdacb3a6c314849fc594b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Type":"Retrieval-augmented"}. This record does not assert independent reproduction. ### T5-11B Exact Match (EM): 37.2. Result ID: 698fdacb3a6c314849fc5944. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Type":"Parametric"}. This record does not assert independent reproduction. ### EMAT-FKSV Exact Match (EM): 36.7. Result ID: 698fdacb3a6c314849fc594e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Access Delay Setting":"Fast Key, Slow Value (FKSV)","Backbone":"T5-base"}. This record does not assert independent reproduction. ### T5-3B Exact Match (EM): 33.6. Result ID: 698fdacb3a6c314849fc5943. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Type":"Parametric"}. This record does not assert independent reproduction. ### EMAT-SKSV Exact Match (EM): 33.2. Result ID: 698fdacb3a6c314849fc594f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Access Delay Setting":"Slow Key, Slow Value (SKSV)","Backbone":"T5-base"}. This record does not assert independent reproduction. ### FiD-base Exact Match (EM): 32.4. Result ID: 698fdacb3a6c314849fc594d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Type":"Retrieval-augmented","Backbone":"T5-base"}. This record does not assert independent reproduction. ### RePAQ-base Exact Match (EM): 29.4. Result ID: 698fdacb3a6c314849fc5947. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Type":"Retrieval-only"}. This record does not assert independent reproduction. ### Dense Retriever Exact Match (EM): 28.9. Result ID: 698fdacb3a6c314849fc5946. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Type":"Retrieval-only"}. This record does not assert independent reproduction. ### T5-large Exact Match (EM): 27.7. Result ID: 698fdacb3a6c314849fc5942. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Type":"Parametric"}. This record does not assert independent reproduction. ### BART-large Exact Match (EM): 27.4. Result ID: 698fdacb3a6c314849fc5945. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Type":"Parametric"}. This record does not assert independent reproduction. ### T5-base Exact Match (EM): 26.6. Result ID: 698fdacb3a6c314849fc5941. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Type":"Parametric"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.