# Short-form Question Answering on TriviaQA Source: [Short-form Question Answering on TriviaQA]() Collection index: [llms.txt]() Data updated: 2026-07-09T07:52:02.062Z Evaluation of model performance on the TriviaQA dataset for Short-form Question Answering, reporting Accuracy. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Short-form Question Answering | | Dataset (including any stated split) | TriviaQA | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 11 of 11 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | HF/SMOLLM2-1.7B\* | 45.1 | Not recorded | 6a4f2b3b32fb937314875e42 | | CO-LMLM-360M-FW | 36.9 | Not recorded | 6a4f2b3b32fb937314875e42 | | CO-LMLM-360M | 31.4 | Not recorded | 6a4f2b3b32fb937314875e42 | | CO-LMLM-135M | 28.4 | Not recorded | 6a4f2b3b32fb937314875e42 | | HF/SMOLLM2-360M\* | 25.4 | Not recorded | 6a4f2b3b32fb937314875e42 | | STANDARD-360M-FW | 18.6 | Not recorded | 6a4f2b3b32fb937314875e42 | | REL-LMLM-360M | 15.6 | Not recorded | 6a4f2b3b32fb937314875e42 | | HF/SMOLLM2-135M\* | 14.7 | Not recorded | 6a4f2b3b32fb937314875e42 | | REL-LMLM-135M | 13.4 | Not recorded | 6a4f2b3b32fb937314875e42 | | STANDARD-360M | 7.5 | Not recorded | 6a4f2b3b32fb937314875e42 | | STANDARD-135M | 6.4 | Not recorded | 6a4f2b3b32fb937314875e42 | ### HF/SMOLLM2-1.7B\* Accuracy: 45.1. Result ID: 6a4f531460b88bb339e550e6. [Reporting paper]() Recorded evaluation configuration: {"Model Size":"1.7B","Training Token Count":"11T"}. This record does not assert independent reproduction. ### CO-LMLM-360M-FW Accuracy: 36.9. Result ID: 6a4f531460b88bb339e550e5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Size":"360M","Training Corpus":"FW"}. This record does not assert independent reproduction. ### CO-LMLM-360M Accuracy: 31.4. Result ID: 6a4f531460b88bb339e550e4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Size":"360M"}. This record does not assert independent reproduction. ### CO-LMLM-135M Accuracy: 28.4. Result ID: 6a4f531460b88bb339e550df. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Size":"135M"}. This record does not assert independent reproduction. ### HF/SMOLLM2-360M\* Accuracy: 25.4. Result ID: 6a4f531460b88bb339e550e0. [Reporting paper]() Recorded evaluation configuration: {"Model Size":"360M","Training Token Count":"4T"}. This record does not assert independent reproduction. ### STANDARD-360M-FW Accuracy: 18.6. Result ID: 6a4f531460b88bb339e550e2. [Reporting paper]() Recorded evaluation configuration: {"Model Size":"360M","Training Corpus":"FW"}. This record does not assert independent reproduction. ### REL-LMLM-360M Accuracy: 15.6. Result ID: 6a4f531460b88bb339e550e3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Size":"360M"}. This record does not assert independent reproduction. ### HF/SMOLLM2-135M\* Accuracy: 14.7. Result ID: 6a4f531460b88bb339e550dc. [Reporting paper]() Recorded evaluation configuration: {"Model Size":"135M","Training Token Count":"2T"}. This record does not assert independent reproduction. ### REL-LMLM-135M Accuracy: 13.4. Result ID: 6a4f531460b88bb339e550de. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Size":"135M"}. This record does not assert independent reproduction. ### STANDARD-360M Accuracy: 7.5. Result ID: 6a4f531460b88bb339e550e1. [Reporting paper]() Recorded evaluation configuration: {"Model Size":"360M"}. This record does not assert independent reproduction. ### STANDARD-135M Accuracy: 6.4. Result ID: 6a4f531460b88bb339e550dd. [Reporting paper]() Recorded evaluation configuration: {"Model Size":"135M"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.