Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Stereo Matching | ETH3D | 50 | Apr 14, 2026 | ||
| Text Classification | IMDB synthetic noise (test) | 50 | Feb 26, 2026 | ||
| Text Classification | AGNews synthetic noise (test) | 50 | Feb 26, 2026 | ||
| Mathematical Reasoning | GSM-Plus (test) | 50 | Mar 18, 2026 | ||
| Point Map Estimation | ETH3D | 50 | May 18, 2026 | ||
| Language Modeling |
| C4 (train) |
| 50 |
| May 22, 2026 |
| Referring Expression Segmentation | refCOCO UMD (val) | 50 | Feb 26, 2026 |
|---|
| Adversarial Attack | CIFAR10 | 50 | May 21, 2026 |
|---|
| General Visual Question Answering | MMStar | 50 | Jul 7, 2026 |
|---|
| Science Reasoning | GPQA | 50 | Apr 10, 2026 |
|---|
| Vision-Language Evaluation | SEED-Bench | 50 | Jun 1, 2026 |
|---|
| Node Classification | Cora Covariate shift (degree split) | 50 | Feb 26, 2026 |
|---|
| Visual Counting | PixMo-Count (test) | 50 | Feb 26, 2026 |
|---|
| Micro-level Graph Reasoning | GraphSQA 1.0 (micro) | 50 | Feb 26, 2026 |
|---|
| Macro-level Graph Reasoning | GraphSQA Macro 1.0 | 50 | Feb 26, 2026 |
|---|
| Graph Reasoning | GraphSQA 1.0 (overall) | 50 | Feb 26, 2026 |
|---|
| Multi-modal Video Evaluation | VideoMME | 50 | Jun 24, 2026 |
|---|
| Semantic Segmentation | Object | 50 | Apr 10, 2026 |
|---|
| Semantic Segmentation | Stuff | 50 | Apr 10, 2026 |
|---|
| Multi-hop Reasoning | StrategyQA | 50 | May 29, 2026 |
|---|
| Accuracy Estimation | PACS | 50 | Feb 26, 2026 |
|---|
| Building Extraction | xBD pre | 50 | Apr 20, 2026 |
|---|
| Building Extraction | Inria | 50 | Apr 20, 2026 |
|---|
| Super-resolution | ImageNet 256 | 50 | May 22, 2026 |
|---|
| OOD Detection | CIFAR-10 (In-distribution) vs LSUN-R (Out-of-distribution) | 50 | Apr 28, 2026 |
|---|