Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Grounded Captioning | BreastStage (BUS) | 32 | Jun 4, 2026 | ||
| Multi-view Clustering | YTF-31 | 32 | Jun 4, 2026 | ||
| Regression | TALENT | 32 | Jun 4, 2026 | ||
| Regression | CTR23 | 32 | Jun 4, 2026 | ||
| Regression | BCCO | 32 | Jun 4, 2026 | ||
| Mathematical Reasoning | GSM8K |
| 32 |
| Jun 4, 2026 |
| Reasoning | 7 Common Reasoning Tasks (ARC-E, ARC-C, BoolQ, WinoGrande, HellaSwag, MMLU, PIQA) | 32 | Jul 7, 2026 |
|---|
| Object Classification | N-CARS | 32 | Jun 9, 2026 |
|---|
| Science Experimentation Reasoning | ScienceWorld (unseen) | 32 | Jul 8, 2026 |
|---|
| Science Experimentation Reasoning | ScienceWorld (seen) | 32 | Jul 8, 2026 |
|---|
| Node Classification | Pokec_z 10-shot | 32 | Jun 4, 2026 |
|---|
| Node Classification | Pokec_n 10-shot | 32 | Jun 4, 2026 |
|---|
| Node Classification | German 10-shot | 32 | Jun 4, 2026 |
|---|
| Node Classification | Credit 10-shot | 32 | Jun 4, 2026 |
|---|
| Node Classification | Credit | 32 | Jun 4, 2026 |
|---|
| Reward Modeling | REWARDHACKBENCH | 32 | Jun 4, 2026 |
|---|
| Short-form generation | TriviaQA | 32 | Jun 4, 2026 |
|---|
| Short-form generation | SVAMP | 32 | Jun 4, 2026 |
|---|
| Short-form generation | SQuAD | 32 | Jun 4, 2026 |
|---|
| Short-form generation | NQ-Open | 32 | Jun 4, 2026 |
|---|
| Short-form generation | BioASQ | 32 | Jun 4, 2026 |
|---|
| Common-sense reasoning | CSR (ARC-Easy, ARC-Challenge, BoolQ, PIQA, SIQA, HellaSwag, OpenBookQA, WinoGrande) zero-shot lm-evaluation-harness v0.4.2 | 32 | Jun 2, 2026 |
|---|
| Remaining Useful Life Prediction | C-MAPSS FD001 (test) | 32 | Jun 18, 2026 |
|---|
| Automated Planning | Planning Problems 600MiB RAM limit | 32 | Jun 2, 2026 |
|---|
| HRTF upsampling | SONICOM (test) | 32 | Jun 2, 2026 |
|---|