Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Classification | OpenML 67 datasets CC18 (10-fold cross-validation average) | 42 | May 27, 2026 | ||
| Agent Behavioral Safety and Helpfulness Evaluation | ToolEmu | 42 | May 27, 2026 | ||
| Vessel Trajectory Prediction | Maritime-MmD+ v1 (test) | 42 | May 27, 2026 | ||
| Vessel Trajectory Prediction | Maritime-MmD+ 1.0 (test) | 42 | May 27, 2026 | ||
| Image Classification | UCF101 |
| 42 |
| Jun 8, 2026 |
| Digit Span | Digit Span | 42 | May 26, 2026 |
|---|
| Temporal Link Prediction | Reddit (inductive) | 42 | Jun 11, 2026 |
|---|
| Temporal Link Prediction | Wikipedia (inductive) | 42 | Jun 11, 2026 |
|---|
| Object Hallucination Evaluation | CHAIR MSCOCO | 42 | May 26, 2026 |
|---|
| Language Model Evaluation | ArxivRollBench 2026a | 42 | May 26, 2026 |
|---|
| Image Classification | CIFAR100 (test) | 42 | May 26, 2026 |
|---|
| Accuracy Estimation | MNIST, USPS, SVHN, COCO, PASCAL, ImageNet source-target transfers | 42 | May 25, 2026 |
|---|
| Accuracy Estimation | Text2SQL source-target transfers Spider BIRD WikiSQL SParC CoSQL SynSQL-2.5M | 42 | May 25, 2026 |
|---|
| Attack on Test-Time Adaptation | ImageNet-C ResNet50 (test) | 42 | May 25, 2026 |
|---|
| Attack on Test-Time Adaptation | CIFAR-100-C ResNet32 (test) | 42 | May 25, 2026 |
|---|
| Attack on Test-Time Adaptation | CIFAR-10-C ResNet32 (test) | 42 | May 25, 2026 |
|---|
| Image Classification | Fashion-MNIST | 42 | May 25, 2026 |
|---|
| Image Classification | MNIST-1797 | 42 | May 25, 2026 |
|---|
| Motion Direction Understanding | MODIRECT-REALBENCH | 42 | May 22, 2026 |
|---|
| Motion Direction Understanding | MODIRECT-SYNBENCH | 42 | May 22, 2026 |
|---|
| Retrieval-Augmented Generation | Bio | 42 | May 22, 2026 |
|---|
| Top-label Confidence Calibration | MNIST | 42 | May 22, 2026 |
|---|
| Image Classification | CIFAR-10 | 42 | May 21, 2026 |
|---|
| Image Classification | CIFAR-100 | 42 | May 21, 2026 |
|---|
| Best-of-N Reranking | Average of 7 benchmarks (including AIME24, LeetCode) (test) | 42 | May 20, 2026 |
|---|