Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Image Classification | CIFAR-10 | 63 | Feb 26, 2026 | ||
| OCR-based Visual Question Answering | OCRVQA | 63 | Jun 8, 2026 | ||
| Zero-shot Common-sense Reasoning | Commonsense Reasoning Benchmarks (BoolQ, PIQA, HellaSwag, WinoGrande, ARC-e, ARC-c, OBQA) zero-shot | 63 | Mar 20, 2026 | ||
| Image Classification | ImageNet-Sketch | 63 | May 29, 2026 | ||
| Medical Question Answering |
|---|
| BioASQ |
| 63 |
| May 19, 2026 |
| OOD Detection | All Datasets Summary In-Domain OOD | 63 | Mar 13, 2026 |
|---|
| Temporal Knowledge Graph Extrapolation Reasoning | GDELT | 63 | May 7, 2026 |
|---|
| Software Engineering Task Resolution | SWE-bench Verified | 63 | May 14, 2026 |
|---|
| Classification | Simulated high-dimensional dataset nine simulation scenarios (test) | 63 | Feb 26, 2026 |
|---|
| Time series forecasting | GIFT-Eval (test) | 63 | Jun 11, 2026 |
|---|
| Sequential Recommendation | Yelp (Overall) | 63 | Apr 7, 2026 |
|---|
| GUI grounding | MMBench-GUI-L2 | 63 | Jul 1, 2026 |
|---|
| Survival Prediction | TCGA-KIRP | 63 | May 19, 2026 |
|---|
| Closed-loop Autonomous Driving Planning | NAVSIM v1 (test) | 63 | Jun 23, 2026 |
|---|
| Brain Tumor Segmentation | BraTS 2021 (val) | 63 | May 19, 2026 |
|---|
| Class-conditional Image Generation | ImageNet 256x256 2012 (val) | 63 | May 8, 2026 |
|---|
| Backdoor Detection | CIFAR-10 (test) | 63 | May 7, 2026 |
|---|
| Closed-ended reasoning | GPQA Diamond (test) | 63 | Feb 26, 2026 |
|---|
| Factual code question answering | CodeSimpleQA English 1.0 | 63 | Feb 26, 2026 |
|---|
| Multilingual Machine Translation | FLORES+ (devtest) | 63 | Feb 26, 2026 |
|---|
| E-commerce Navigation and Search | WebShop semantic shift Hidden drift | 63 | Feb 26, 2026 |
|---|
| Embodied Task Completion | EB-Habitat | 63 | May 27, 2026 |
|---|
| Online Bin Packing | Weibull distribution | 63 | Feb 26, 2026 |
|---|
| General Reasoning | MMLU-Pro | 63 | Apr 10, 2026 |
|---|
| General VQA | MMVet | 63 | May 18, 2026 |
|---|