Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Multi-Hop Question Answering | Multi-Hop QA (HotpotQA, 2Wiki, Musique, Bamboogle) | 64 | Jun 11, 2026 | ||
| General Knowledge Reasoning | MMLU-CF | 64 | Apr 20, 2026 | ||
| Theory of Mind | HiToM | 64 | May 28, 2026 | ||
| Medical Visual Question Answering | OmniMedVQA (test) | 64 | Jun 26, 2026 | ||
| Misinformation Detection | AMTCele | 64 | Feb 26, 2026 | ||
| ADE20k |
| 64 |
| Feb 26, 2026 |
| Continual Learning | Camelyon-TCGA | 64 | Feb 26, 2026 |
|---|
| 3D Spatial Reasoning | 3DSRBench | 64 | Jul 7, 2026 |
|---|
| OCR-related Understanding Tasks | TextVQA (val) | 64 | Apr 20, 2026 |
|---|
| Preference Evaluation | AlpacaEval 2 | 64 | Jun 9, 2026 |
|---|
| Jailbreak Attack | Advbench subset | 64 | May 26, 2026 |
|---|
| Surface Normal Estimation | PASCAL Context | 64 | Jun 16, 2026 |
|---|
| Saliency Detection | PASCAL Context | 64 | Jun 16, 2026 |
|---|
| Text-to-Image Generation | MS COCO zero-shot | 64 | Mar 31, 2026 |
|---|
| Social Bias Evaluation | FairFace | 64 | Jul 2, 2026 |
|---|
| Dataset Distillation | ImageNet 1K (val) | 64 | Feb 26, 2026 |
|---|
| Mortality prediction | MIMIC-IV (test) | 64 | Apr 21, 2026 |
|---|
| Class-Incremental Learning | CUB200 | 64 | May 28, 2026 |
|---|
| Tabular Data Synthesis Fidelity | texture | 64 | Feb 26, 2026 |
|---|
| Video Recognition | SS v2 | 64 | May 28, 2026 |
|---|
| Image Classification | 10 fine-grained recognition datasets (Aircraft, Caltech, Cars, DTD, EuroSAT, Flower, Food101, Pets, SUN397, UCF101) (test) | 64 | May 6, 2026 |
|---|
| Image Compression | Tecnick | 64 | Jun 23, 2026 |
|---|
| Survival Prediction | LUAD | 64 | Jun 24, 2026 |
|---|
| Sequence Classification | MASSIVE | 64 | Feb 26, 2026 |
|---|
| Sequence Classification | ATIS | 64 | Feb 26, 2026 |
|---|