# Temporal Question Answering on ReasonQA Multi-hop Source: [Temporal Question Answering on ReasonQA Multi-hop]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:04:18.742Z Evaluation of model performance on the ReasonQA Multi-hop dataset for temporal question answering tasks, typically measured using Set Accuracy and Answer F1. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Temporal Question Answering | | Dataset (including any stated split) | ReasonQA Multi-hop | | Metric | Set Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 7 of 7 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Set Accuracy](): Higher is better; unit: PERCENT. - [Answer F1](): Higher is better; unit: PERCENT. ## Recorded results | Method | Set Accuracy | Result date | Report paper | | --- | --- | --- | --- | | T5-large PIT-SFT | 85 | Not recorded | 68fa740c1e209131cea5f719 | | T5-base PIT-SFT | 78 | Not recorded | 68fa740c1e209131cea5f719 | | T5-large SFT | 71 | Not recorded | 68fa740c1e209131cea5f719 | | T5-base SFT | 59.1 | Not recorded | 68fa740c1e209131cea5f719 | | GPT-4 | 51.6 | Not recorded | 68fa740c1e209131cea5f719 | | FLAN-T5-XL | 35.5 | Not recorded | 68fa740c1e209131cea5f719 | | GPT-3.5 | 31.2 | Not recorded | 68fa740c1e209131cea5f719 | ### T5-large PIT-SFT Set Accuracy: 85. Result ID: 699316253a6c314849139c9f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"T5-large","Training strategy":"PIT-SFT"}. This record does not assert independent reproduction. ### T5-base PIT-SFT Set Accuracy: 78. Result ID: 699316253a6c314849139c9d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"T5-base","Training strategy":"PIT-SFT"}. This record does not assert independent reproduction. ### T5-large SFT Set Accuracy: 71. Result ID: 699316253a6c314849139c9e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"T5-large","Training strategy":"Supervised fine-tuning"}. This record does not assert independent reproduction. ### T5-base SFT Set Accuracy: 59.1. Result ID: 699316253a6c314849139c9c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"T5-base","Training strategy":"Supervised fine-tuning"}. This record does not assert independent reproduction. ### GPT-4 Set Accuracy: 51.6. Result ID: 699316253a6c314849139c9b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model version":"gpt4-0613","Few-shot":"one-shot"}. This record does not assert independent reproduction. ### FLAN-T5-XL Set Accuracy: 35.5. Result ID: 699316253a6c314849139c99. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameters":"3B","Few-shot":"one-shot"}. This record does not assert independent reproduction. ### GPT-3.5 Set Accuracy: 31.2. Result ID: 699316253a6c314849139c9a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model version":"gpt3.5-turbo","Few-shot":"one-shot"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.