# Question Answering on COTEMPQA 1.0 (test) Source: [Question Answering on COTEMPQA 1.0 (test)]() Collection index: [llms.txt]() Data updated: 2026-02-27T09:19:46.886Z Evaluation of model performance on the test split of the COTEMPQA 1.0 dataset for Question Answering, utilizing detailed metrics including Equal, Overlap, and During score breakdowns. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Question Answering | | Dataset (including any stated split) | COTEMPQA 1.0 (test) | | Metric | Equal Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 17 of 17 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Equal Accuracy](): Higher is better; unit: PERCENT. - [Equal F1](): Higher is better; unit: PERCENT. - [Equal Average Score](): Higher is better; unit: PERCENT. - [Overlap Accuracy](): Higher is better; unit: PERCENT. - [Overlap F1](): Higher is better; unit: PERCENT. - [Overlap Average Score](): Higher is better; unit: PERCENT. - [During Accuracy](): Higher is better; unit: PERCENT. - [During F1](): Higher is better; unit: PERCENT. - [During Average Score](): Higher is better; unit: PERCENT. - [Mix Accuracy](): Higher is better; unit: PERCENT. - [Mix F1](): Higher is better; unit: PERCENT. - [Mix Average Score](): Higher is better; unit: PERCENT. - [Overall Average Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Equal Accuracy | Result date | Report paper | | --- | --- | --- | --- | | HUMAN | 97 | Not recorded | 68fa73951e209131cea5d5ee | | GPT-4 | 91.1 | Not recorded | 68fa73951e209131cea5d5ee | | GPT-3.5-Turbo | 59.4 | Not recorded | 68fa73951e209131cea5d5ee | | WIZARDMATH | 36.7 | Not recorded | 68fa73951e209131cea5d5ee | | WIZARDMATH | 23.9 | Not recorded | 68fa73951e209131cea5d5ee | | WIZARDCODER | 19.5 | Not recorded | 68fa73951e209131cea5d5ee | | CODELLAMA | 16.1 | Not recorded | 68fa73951e209131cea5d5ee | | GPT-3.5-Turbo | 13.8 | Not recorded | 68fa73951e209131cea5d5ee | | WIZARDMATH | 12.4 | Not recorded | 68fa73951e209131cea5d5ee | | LLAMA | 11.9 | Not recorded | 68fa73951e209131cea5d5ee | | GPT-4 | 11.2 | Not recorded | 68fa73951e209131cea5d5ee | | LLAMA | 11.2 | Not recorded | 68fa73951e209131cea5d5ee | | WIZARDCODER | 9.2 | Not recorded | 68fa73951e209131cea5d5ee | | WIZARDCODER | 8.3 | Not recorded | 68fa73951e209131cea5d5ee | | CODELLAMA | 7.6 | Not recorded | 68fa73951e209131cea5d5ee | | CODELLAMA | 6.4 | Not recorded | 68fa73951e209131cea5d5ee | | LLAMA | 4.1 | Not recorded | 68fa73951e209131cea5d5ee | ### HUMAN Equal Accuracy: 97. Result ID: 69a161a935dfcabb00e6ad9f. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### GPT-4 Equal Accuracy: 91.1. Result ID: 69a161a935dfcabb00e6ad92. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### GPT-3.5-Turbo Equal Accuracy: 59.4. Result ID: 69a161a935dfcabb00e6ad91. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### WIZARDMATH Equal Accuracy: 36.7. Result ID: 69a161a935dfcabb00e6ad9e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameter Scale":"70B"}. This record does not assert independent reproduction. ### WIZARDMATH Equal Accuracy: 23.9. Result ID: 69a161a935dfcabb00e6ad9a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameter Scale":"13B"}. This record does not assert independent reproduction. ### WIZARDCODER Equal Accuracy: 19.5. Result ID: 69a161a935dfcabb00e6ad9c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameter Scale":"34B"}. This record does not assert independent reproduction. ### CODELLAMA Equal Accuracy: 16.1. Result ID: 69a161a935dfcabb00e6ad9b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameter Scale":"34B"}. This record does not assert independent reproduction. ### GPT-3.5-Turbo Equal Accuracy: 13.8. Result ID: 69a161a935dfcabb00e6ad8f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### WIZARDMATH Equal Accuracy: 12.4. Result ID: 69a161a935dfcabb00e6ad96. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameter Scale":"7B"}. This record does not assert independent reproduction. ### LLAMA Equal Accuracy: 11.9. Result ID: 69a161a935dfcabb00e6ad9d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameter Scale":"70B"}. This record does not assert independent reproduction. ### GPT-4 Equal Accuracy: 11.2. Result ID: 69a161a935dfcabb00e6ad90. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### LLAMA Equal Accuracy: 11.2. Result ID: 69a161a935dfcabb00e6ad99. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameter Scale":"13B"}. This record does not assert independent reproduction. ### WIZARDCODER Equal Accuracy: 9.2. Result ID: 69a161a935dfcabb00e6ad94. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameter Scale":"7B"}. This record does not assert independent reproduction. ### WIZARDCODER Equal Accuracy: 8.3. Result ID: 69a161a935dfcabb00e6ad98. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameter Scale":"13B"}. This record does not assert independent reproduction. ### CODELLAMA Equal Accuracy: 7.6. Result ID: 69a161a935dfcabb00e6ad97. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameter Scale":"13B"}. This record does not assert independent reproduction. ### CODELLAMA Equal Accuracy: 6.4. Result ID: 69a161a935dfcabb00e6ad93. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameter Scale":"7B"}. This record does not assert independent reproduction. ### LLAMA Equal Accuracy: 4.1. Result ID: 69a161a935dfcabb00e6ad95. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameter Scale":"7B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.