Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Classification | Pluvial Flood 50% noise added Noisy (5-fold CV) | 30 | May 1, 2026 | ||
| Classification | RSI-CB256 ResNet downsampled features PCA-512D (5-fold CV) | 30 | May 1, 2026 | ||
| Classification | Census of Individual Trees synthetic samples added Balanced (5-fold CV) | 30 | May 1, 2026 | ||
| Security Goal Extraction | SecGoal (test) | 30 | May 1, 2026 | ||
| Policy Synthesis | Warehouse MDPs Property: Rmin R{“steps”}min=? [F “goal”] W512/W1024 |
| 30 |
| May 1, 2026 |
| Policy Synthesis | Warehouse MDPs Property: Pmax F “goal” W512 W1024 | 30 | May 1, 2026 |
|---|
| Click-Through Rate Prediction | ICM 500 | 30 | May 1, 2026 |
|---|
| Click-Through Rate Prediction | ICM 150 | 30 | May 1, 2026 |
|---|
| Zero-shot classification | Eight downstream tasks zero-shot | 30 | Apr 30, 2026 |
|---|
| Summarization | CNN/DM | 30 | May 20, 2026 |
|---|
| Logic | Synlogic | 30 | Apr 30, 2026 |
|---|
| Code | LiveCode | 30 | Apr 30, 2026 |
|---|
| Knowledge Evaluation | IKP | 30 | Apr 29, 2026 |
|---|
| Needle-in-the-Haystack retrieval | PG-19 mini 10K context | 30 | Apr 29, 2026 |
|---|
| Long-context retrieval | Needle-in-the-Haystack 10k-context | 30 | Apr 29, 2026 |
|---|
| End-task performance evaluation | SRA-Bench | 30 | Apr 28, 2026 |
|---|
| Data analysis step verification | DABStep | 30 | Apr 28, 2026 |
|---|
| Point Cloud Segmentation | ScanNet v2 (val) | 30 | Apr 28, 2026 |
|---|
| General Visual Understanding | VisNumBench | 30 | May 14, 2026 |
|---|
| General Visual Understanding | MMMU Pro | 30 | May 14, 2026 |
|---|
| Spatio-temporal learning | Non-linear Fokker-Planck equation Equation (34) (test) | 30 | Apr 28, 2026 |
|---|
| Job Shop Scheduling | Synthetic 100 Instances per Size (val) | 30 | Apr 28, 2026 |
|---|
| Preference Alignment Evaluation | Nectar | 30 | Jun 4, 2026 |
|---|
| Multi-speaker Automatic Speech Recognition | AliMeeting (test) | 30 | Jun 12, 2026 |
|---|
| Brain Tumor Segmentation | BraTS 2024 (test) | 30 | Apr 27, 2026 |
|---|