Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Multimodal tool-use | GTA | 33 | Jul 1, 2026 | ||
| Psychosis detection | PSY-IAT (50 CV folds) | 33 | Mar 18, 2026 | ||
| Reasoning | Reasoning Benchmarks GSM8K, MATH-500, AIME24, AIME25, GPQA-D | 33 | Mar 18, 2026 | ||
| Multimodal Understanding and Question Answering | Multimodal Benchmarks MME, OCRBench, DocVQA, RealWorldQA, VLMBlind | 33 | Mar 18, 2026 | ||
| LLM Inference | LLaMA2 7B |
| 33 |
| Apr 28, 2026 |
| Multi-discipline Multimodal Reasoning | MMMU | 33 | Mar 24, 2026 |
|---|
| Hierarchical Text Classification | AAPD | 33 | Mar 18, 2026 |
|---|
| New View Synthesis | T&T | 33 | Mar 17, 2026 |
|---|
| Object Removal | OBER (test) | 33 | May 13, 2026 |
|---|
| Machine Unlearning | ImageNet | 33 | May 15, 2026 |
|---|
| Atomic and excitation energy prediction | Beryllium NIST ASD | 33 | Mar 17, 2026 |
|---|
| 360 Image Quality Assessment | CVIQD (test) | 33 | Mar 17, 2026 |
|---|
| 360 Image Quality Assessment | JUFE (test) | 33 | Mar 17, 2026 |
|---|
| Web Information Extraction | LIVEWEB-IE Overall 1.0 (test) | 33 | Mar 17, 2026 |
|---|
| Web Information Extraction | LIVEWEB-IE Type IV 1.0 (test) | 33 | Mar 17, 2026 |
|---|
| Web Information Extraction | LIVEWEB-IE Type III 1.0 (test) | 33 | Mar 17, 2026 |
|---|
| Web Information Extraction | LIVEWEB-IE Type II 1.0 (test) | 33 | Mar 17, 2026 |
|---|
| Web Information Extraction | LIVEWEB-IE Type I 1.0 (test) | 33 | Mar 17, 2026 |
|---|
| Node Classification | BlogCatalog 6-way Social Media (test) | 33 | Mar 17, 2026 |
|---|
| Node Classification | Physics Co-authorship 5-way (test) | 33 | Mar 17, 2026 |
|---|
| Node Classification | Computers 10-way E-commerce (test) | 33 | Mar 17, 2026 |
|---|
| Math Reasoning | AIME 25 | 33 | Mar 16, 2026 |
|---|
| Policy Error Rate Estimation | HC-MNIST (out-sample) | 33 | Mar 13, 2026 |
|---|
| Anomaly Detection | Grid Loss D3 train 13.69% (test) | 33 | Mar 13, 2026 |
|---|
| Anomaly Detection | Grid Loss D2 Train 1.04% (test) | 33 | Mar 13, 2026 |
|---|