Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Vehicle Classification | Vehicle Dataset 5-fold cross-validation | 60 | May 11, 2026 | ||
| Node Classification | OGB-ARXIV (test) | 60 | May 8, 2026 | ||
| Medical Jargon Extraction | MIMIC medical jargon extraction IV | 60 | May 8, 2026 | ||
| Ranking Correlation Analysis | LAM benchmark | 60 | May 4, 2026 | ||
| Benchmark Subset Selection | LAM Evaluation Benchmark 40 tasks |
| 60 |
| May 4, 2026 |
| Byzantine-robust Federated Learning | FEMNIST and CelebA (averaged) (test) | 60 | May 4, 2026 |
|---|
| Poison detection | ImageNette | 60 | Apr 28, 2026 |
|---|
| Poison detection | CIFAR10 | 60 | Apr 28, 2026 |
|---|
| Image Classification | CIFAR-100 LTN | 60 | May 25, 2026 |
|---|
| Neuron Labeling | ImageNet-1K | 60 | Apr 27, 2026 |
|---|
| Neurodevelopmental Disorder Diagnosis | ABIDE-I LEUVEN AAL116 atlas | 60 | Jun 30, 2026 |
|---|
| Spatial Reasoning | 3DSRBench | 60 | May 26, 2026 |
|---|
| Language Understanding | MMLU-Pro | 60 | May 25, 2026 |
|---|
| Opinion Alignment | WGM | 60 | Apr 23, 2026 |
|---|
| Text Embedding | FinMTEB | 60 | Apr 21, 2026 |
|---|
| Video Captioning Evaluation Correlation | VATEX Eval | 60 | Jun 30, 2026 |
|---|
| Factuality Detection | Short-form QA (Average of NQ, PopQA, TriviaQA, SimpleQA) (test) | 60 | Apr 20, 2026 |
|---|
| Online Class Incremental Learning | Tiny-Imagenet | 60 | Apr 16, 2026 |
|---|
| Mathematical Reasoning | AMC 23 | 60 | May 29, 2026 |
|---|
| Mathematics Problem Solving | MATH500 (test) | 60 | Apr 14, 2026 |
|---|
| Mathematical Reasoning | GSM8K (test) | 60 | Apr 14, 2026 |
|---|
| Science Question Answering | GPQA main (test) | 60 | Apr 14, 2026 |
|---|
| Mathematical Reasoning | MATH 500 | 60 | Apr 14, 2026 |
|---|
| Mathematical Reasoning | GSM8K | 60 | Apr 14, 2026 |
|---|
| Mathematical Reasoning | AQuA | 60 | Apr 14, 2026 |
|---|