# Climate Discovery on ClimaBench 2000–2024 Source: [Climate Discovery on ClimaBench 2000–2024]() Collection index: [llms.txt]() Data updated: 2026-04-21T09:15:49.701Z Evaluation of models on the ClimaBench 2000–2024 dataset for climate discovery tasks, reporting metrics such as AE, SC, PS, RBA, and Overall score. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Climate Discovery | | Dataset (including any stated split) | ClimaBench 2000–2024 | | Metric | AE (Absolute Error) | | Unit | SCALAR | | Direction | Lower is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [AE (Absolute Error)](): Lower is better; unit: SCALAR. - [SC (Score)](): Higher is better; unit: SCALAR. - [PS (Score)](): Higher is better; unit: SCALAR. - [RBA (Metric)](): Lower is better; unit: SCALAR. - [Overall Score](): Higher is better; unit: SCALAR. ## Recorded results | Method | AE (Absolute Error) | Result date | Report paper | | --- | --- | --- | --- | | DeepSeek-R1 | 7.38 | Not recorded | 69e704bb7d0172140ec7ee73 | | Qwen3-235B | 7.42 | Not recorded | 69e704bb7d0172140ec7ee73 | | GPT-4o | 7.55 | Not recorded | 69e704bb7d0172140ec7ee73 | | ResearchAgent | 8.05 | Not recorded | 69e704bb7d0172140ec7ee73 | | DS-Agent | 8.24 | Not recorded | 69e704bb7d0172140ec7ee73 | | ResearchAgent | 8.24 | Not recorded | 69e704bb7d0172140ec7ee73 | | ResearchAgent | 8.28 | Not recorded | 69e704bb7d0172140ec7ee73 | | DS-Agent | 8.35 | Not recorded | 69e704bb7d0172140ec7ee73 | | DS-Agent | 8.38 | Not recorded | 69e704bb7d0172140ec7ee73 | | Agent Laboratory | 8.62 | Not recorded | 69e704bb7d0172140ec7ee73 | | DeepAnalyze | 8.62 | Not recorded | 69e704bb7d0172140ec7ee73 | | DeepAnalyze | 8.62 | Not recorded | 69e704bb7d0172140ec7ee73 | | DeepAnalyze | 8.62 | Not recorded | 69e704bb7d0172140ec7ee73 | | Agent Laboratory | 8.75 | Not recorded | 69e704bb7d0172140ec7ee73 | | Agent Laboratory | 8.78 | Not recorded | 69e704bb7d0172140ec7ee73 | | ClimAgent | 9.22 | Not recorded | 69e704bb7d0172140ec7ee73 | | ClimAgent | 9.62 | Not recorded | 69e704bb7d0172140ec7ee73 | | ClimAgent | 9.65 | Not recorded | 69e704bb7d0172140ec7ee73 | ### DeepSeek-R1 AE (Absolute Error): 7.38. Result ID: 69e7403b47f34ce924cdbb94. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-R1-671B"}. This record does not assert independent reproduction. ### Qwen3-235B AE (Absolute Error): 7.42. Result ID: 69e7403b47f34ce924cdbb9a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-235B"}. This record does not assert independent reproduction. ### GPT-4o AE (Absolute Error): 7.55. Result ID: 69e7403b47f34ce924cdbb8e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"GPT-4o"}. This record does not assert independent reproduction. ### ResearchAgent AE (Absolute Error): 8.05. Result ID: 69e7403b47f34ce924cdbb90. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"GPT-4o"}. This record does not assert independent reproduction. ### DS-Agent AE (Absolute Error): 8.24. Result ID: 69e7403b47f34ce924cdbb8f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"GPT-4o"}. This record does not assert independent reproduction. ### ResearchAgent AE (Absolute Error): 8.24. Result ID: 69e7403b47f34ce924cdbb96. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-R1-671B"}. This record does not assert independent reproduction. ### ResearchAgent AE (Absolute Error): 8.28. Result ID: 69e7403b47f34ce924cdbb9c. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-235B"}. This record does not assert independent reproduction. ### DS-Agent AE (Absolute Error): 8.35. Result ID: 69e7403b47f34ce924cdbb95. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-R1-671B"}. This record does not assert independent reproduction. ### DS-Agent AE (Absolute Error): 8.38. Result ID: 69e7403b47f34ce924cdbb9b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-235B"}. This record does not assert independent reproduction. ### Agent Laboratory AE (Absolute Error): 8.62. Result ID: 69e7403b47f34ce924cdbb91. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"GPT-4o"}. This record does not assert independent reproduction. ### DeepAnalyze AE (Absolute Error): 8.62. Result ID: 69e7403b47f34ce924cdbb92. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"GPT-4o"}. This record does not assert independent reproduction. ### DeepAnalyze AE (Absolute Error): 8.62. Result ID: 69e7403b47f34ce924cdbb98. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-R1-671B"}. This record does not assert independent reproduction. ### DeepAnalyze AE (Absolute Error): 8.62. Result ID: 69e7403b47f34ce924cdbb9e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-235B"}. This record does not assert independent reproduction. ### Agent Laboratory AE (Absolute Error): 8.75. Result ID: 69e7403b47f34ce924cdbb97. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-R1-671B"}. This record does not assert independent reproduction. ### Agent Laboratory AE (Absolute Error): 8.78. Result ID: 69e7403b47f34ce924cdbb9d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-235B"}. This record does not assert independent reproduction. ### ClimAgent AE (Absolute Error): 9.22. Result ID: 69e7403b47f34ce924cdbb93. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"GPT-4o"}. This record does not assert independent reproduction. ### ClimAgent AE (Absolute Error): 9.62. Result ID: 69e7403b47f34ce924cdbb99. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-R1-671B"}. This record does not assert independent reproduction. ### ClimAgent AE (Absolute Error): 9.65. Result ID: 69e7403b47f34ce924cdbb9f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-235B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.