# Temporal Question Answering on TempReason OBQA-L3 Source: [Temporal Question Answering on TempReason OBQA-L3]() Collection index: [llms.txt]() Data updated: 2026-04-28T10:04:38.693Z Evaluation of model performance on the TempReason OBQA-L3 dataset for Temporal Question Answering, reporting Exact Match (EM) and F1 scores. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Temporal Question Answering | | Dataset (including any stated split) | TempReason OBQA-L3 | | Metric | Exact Match (EM) | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 17 of 17 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Exact Match (EM)](): Higher is better; unit: PERCENT. - [F1 Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Exact Match (EM) | Result date | Report paper | | --- | --- | --- | --- | | DeepSeek-V3-AdapTime | 49.8 | Not recorded | 69f03f6e55a3c32af89fa460 | | DeepSeek-V3-Step-back | 48.8 | Not recorded | 69f03f6e55a3c32af89fa460 | | DeepSeek-V3-CoT | 47 | Not recorded | 69f03f6e55a3c32af89fa460 | | DeepSeek-V3-ICL | 43.6 | Not recorded | 69f03f6e55a3c32af89fa460 | | GPT-4 | 43.1 | Not recorded | 69f03f6e55a3c32af89fa460 | | DeepSeek-V3-Self-refinement | 41.1 | Not recorded | 69f03f6e55a3c32af89fa460 | | TG-LLM | 35.6 | Not recorded | 69f03f6e55a3c32af89fa460 | | REMEMO-large | 33.4 | Not recorded | 69f03f6e55a3c32af89fa460 | | T5-large | 28.8 | Not recorded | 69f03f6e55a3c32af89fa460 | | Qwen-3-8B-CoT | 28.8 | Not recorded | 69f03f6e55a3c32af89fa460 | | Qwen-3-8B-AdapTime | 28.8 | Not recorded | 69f03f6e55a3c32af89fa460 | | REMEMO-base | 28.5 | Not recorded | 69f03f6e55a3c32af89fa460 | | T5-base | 23.8 | Not recorded | 69f03f6e55a3c32af89fa460 | | Qwen-3-8B-ICL | 23.1 | Not recorded | 69f03f6e55a3c32af89fa460 | | LLaMA-3-8B-CoT | 16.5 | Not recorded | 69f03f6e55a3c32af89fa460 | | LLaMA-3-8B-AdapTime | 14.5 | Not recorded | 69f03f6e55a3c32af89fa460 | | LLaMA-3-8B-ICL | 1.8 | Not recorded | 69f03f6e55a3c32af89fa460 | ### DeepSeek-V3-AdapTime Exact Match (EM): 49.8. Result ID: 69f0862447f34ce924d70090. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3-0324","Strategy":"AdapTime"}. This record does not assert independent reproduction. ### DeepSeek-V3-Step-back Exact Match (EM): 48.8. Result ID: 69f0862447f34ce924d7008e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3-0324","Strategy":"Step-back"}. This record does not assert independent reproduction. ### DeepSeek-V3-CoT Exact Match (EM): 47. Result ID: 69f0862447f34ce924d7008d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3-0324","Strategy":"Chain-of-Thought (CoT)"}. This record does not assert independent reproduction. ### DeepSeek-V3-ICL Exact Match (EM): 43.6. Result ID: 69f0862447f34ce924d7008c. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3-0324","Strategy":"In-context Learning (ICL)"}. This record does not assert independent reproduction. ### GPT-4 Exact Match (EM): 43.1. Result ID: 69f0862447f34ce924d70084. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"GPT-4","Strategy":"Vanilla"}. This record does not assert independent reproduction. ### DeepSeek-V3-Self-refinement Exact Match (EM): 41.1. Result ID: 69f0862447f34ce924d7008f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3-0324","Strategy":"Self-refinement"}. This record does not assert independent reproduction. ### TG-LLM Exact Match (EM): 35.6. Result ID: 69f0862447f34ce924d70085. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Strategy":"Temporal Reasoning"}. This record does not assert independent reproduction. ### REMEMO-large Exact Match (EM): 33.4. Result ID: 69f0862447f34ce924d70083. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"REMEMO-large","Strategy":"Supervised Fine-tuning"}. This record does not assert independent reproduction. ### T5-large Exact Match (EM): 28.8. Result ID: 69f0862447f34ce924d70081. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"T5-large","Strategy":"Supervised Fine-tuning"}. This record does not assert independent reproduction. ### Qwen-3-8B-CoT Exact Match (EM): 28.8. Result ID: 69f0862447f34ce924d7008a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen-3-8B","Strategy":"Chain-of-Thought (CoT)"}. This record does not assert independent reproduction. ### Qwen-3-8B-AdapTime Exact Match (EM): 28.8. Result ID: 69f0862447f34ce924d7008b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen-3-8B","Strategy":"AdapTime"}. This record does not assert independent reproduction. ### REMEMO-base Exact Match (EM): 28.5. Result ID: 69f0862447f34ce924d70082. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"REMEMO-base","Strategy":"Supervised Fine-tuning"}. This record does not assert independent reproduction. ### T5-base Exact Match (EM): 23.8. Result ID: 69f0862447f34ce924d70080. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"T5-base","Strategy":"Supervised Fine-tuning"}. This record does not assert independent reproduction. ### Qwen-3-8B-ICL Exact Match (EM): 23.1. Result ID: 69f0862447f34ce924d70089. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen-3-8B","Strategy":"In-context Learning (ICL)"}. This record does not assert independent reproduction. ### LLaMA-3-8B-CoT Exact Match (EM): 16.5. Result ID: 69f0862447f34ce924d70087. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"LLaMA-3.1-8B-Instruct","Strategy":"Chain-of-Thought (CoT)"}. This record does not assert independent reproduction. ### LLaMA-3-8B-AdapTime Exact Match (EM): 14.5. Result ID: 69f0862447f34ce924d70088. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"LLaMA-3.1-8B-Instruct","Strategy":"AdapTime"}. This record does not assert independent reproduction. ### LLaMA-3-8B-ICL Exact Match (EM): 1.8. Result ID: 69f0862447f34ce924d70086. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"LLaMA-3.1-8B-Instruct","Strategy":"In-context Learning (ICL)"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.