Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Two-Sample Testing | BLOB (test) | 49 | Jun 9, 2026 | ||
| Two-Sample Testing | CIFAR10 WRN28 | 49 | Jun 9, 2026 | ||
| Change Point Detection | Synthetic SBM Change with possibly partial evolution | 49 | Jun 8, 2026 | ||
| Change Point Detection | Synthetic SBM changing speed CPD (full evolution) | 49 | Jun 8, 2026 | ||
| Change Point Detection | Synthetic SBM endpoint deviation and full evolution |
| 49 |
| Jun 8, 2026 |
| Change Point Detection | Synthetic SBM endpoint deviation and partial evolution | 49 | Jun 8, 2026 |
|---|
| Change Point Detection | CPD with endpoint deviation and full evolution (SBM) | 49 | Jun 8, 2026 |
|---|
| Change Point Detection | Synthetic SBM datasets changing speed (test) | 49 | Jun 8, 2026 |
|---|
| Change Point Detection | Synthetic SBM Full evolution to endpoint graph | 49 | Jun 8, 2026 |
|---|
| Change Point Detection | Synthetic SBM pace changes on fixed trajectories | 49 | Jun 8, 2026 |
|---|
| Change Point Detection | CPD synthetic SBM endpoint deviation and partial evolution | 49 | Jun 8, 2026 |
|---|
| High-stakes specialized classification | ChemProt (test) | 49 | Jun 2, 2026 |
|---|
| General classification | Banking77 (test) | 49 | Jun 2, 2026 |
|---|
| Drift Detection | Synthetic Data Streams various configurations | 49 | May 29, 2026 |
|---|
| Document Visual Question Answering | DocVQA | 49 | Jul 3, 2026 |
|---|
| Forecasting | ETTm1 | 49 | Jun 9, 2026 |
|---|
| Image Classification | CIFAR10 (test) | 49 | May 26, 2026 |
|---|
| Embodied Decision Making | ALFWorld held-out (test) | 49 | May 25, 2026 |
|---|
| Classification | HateSpeech18 | 49 | May 21, 2026 |
|---|
| Travel Planning | TravelPlanner (test) | 49 | Jul 7, 2026 |
|---|
| Learning to Defer | CIFAR-100 Clean | 49 | May 20, 2026 |
|---|
| Latency Measurement | LLaMA-8B-Instruct Chunked Prefill 3.1 (inference) | 49 | May 19, 2026 |
|---|
| Tool-calling | Confetti | 49 | May 15, 2026 |
|---|
| Forgery Localization | OpenMMsec | 49 | May 15, 2026 |
|---|
| Time-series forecasting | Electricity | 49 | May 14, 2026 |
|---|