Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Natural Language Inference | XNLI 1.0 (test) | 40 | May 14, 2026 | ||
| Image Classification | 11 Classification Datasets (ImageNet, SUN397, FGVC Aircraft, EuroSAT, Stanford Cars, Food-101, Oxford-IIIT Pets, Oxford Flowers 102, Caltech101, DTD, UCF101) | 39 | Jul 2, 2026 | ||
| Harm Evaluation | PrincipalBench 36-item core | 39 | Jun 30, 2026 | ||
| EV Demand Forecasting | Palo Alto Step 6 | 39 | Jun 30, 2026 | ||
| EV Demand Forecasting | Palo Alto Step 1 |
| 39 |
| Jun 30, 2026 |
| ultrasound speckle reduction | UterUS (test) | 39 | Jun 25, 2026 |
|---|
| Training Efficiency Profiling | Qwen3 profiling S=4096 (train) | 39 | Jun 23, 2026 |
|---|
| Image Classification | 8 computer vision tasks | 39 | Jun 23, 2026 |
|---|
| Code-Switched Question Answering | CodeMixQA | 39 | Jun 19, 2026 |
|---|
| ReDoS vulnerability detection | 12 open-source Python projects undisclosed ReDoS | 39 | Jun 19, 2026 |
|---|
| Multi-turn agent interaction | ALFWorld ScienceWorld WebShop Average | 39 | Jun 29, 2026 |
|---|
| Multi-turn agent interaction | WebShop | 39 | Jun 29, 2026 |
|---|
| Infrared Small Target Detection | IRDST Dynamic Scenes | 39 | Jun 16, 2026 |
|---|
| Infrared Small Target Detection | ITSDT-15K Static Scenes | 39 | Jun 16, 2026 |
|---|
| Time Series Prediction | Synthetic Data 5 systems | 39 | Jun 12, 2026 |
|---|
| Equilibrium State Estimation | Synthetic data | 39 | Jun 12, 2026 |
|---|
| Language Modeling and Reasoning | ARC-Challenge (AC), ARC-Easy (AE), HellaSwag (HS), LAMBADA-openai (LO), LAMBADA-standard (LS), PIQA (PQ), WinoGrande (WG) zero-shot | 39 | Jun 12, 2026 |
|---|
| Word alignment | TIMIT (test) | 39 | Jul 9, 2026 |
|---|
| Naturalness | CMU ARCTIC | 39 | Jun 11, 2026 |
|---|
| Intelligibility | CMU ARCTIC | 39 | Jun 11, 2026 |
|---|
| Speaker Similarity | CMU ARCTIC | 39 | Jun 11, 2026 |
|---|
| Voice Conversion | CMU ARCTIC (test) | 39 | Jun 11, 2026 |
|---|
| Video Instance Segmentation | OVIS (diagnostic) | 39 | Jun 8, 2026 |
|---|
| Prognostics | NB14 | 39 | Jun 5, 2026 |
|---|
| Prognostics | NC-P | 39 | Jun 5, 2026 |
|---|