Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Jailbreak Attack | JBB Behaviors | 35 | Apr 3, 2026 | ||
| Long-context Memory Evaluation | Mem-Gallery | 35 | Apr 2, 2026 | ||
| Question Answering | gsm8k (test) | 35 | May 15, 2026 | ||
| Graph Classification | Mutagenicity | 35 | Jun 16, 2026 | ||
| Membership Inference Attack | MIMIR HackerNews | 35 | Apr 1, 2026 | ||
| Membership Inference Attack |
| MIMIR DM Mathematics |
| 35 |
| Apr 1, 2026 |
| Membership Inference Attack | MIMIR Arxiv | 35 | Apr 1, 2026 |
|---|
| Membership Inference Attack | MIMIR Github | 35 | Apr 1, 2026 |
|---|
| Long-term forecasting | WX (Wanshou) (test) | 35 | Apr 1, 2026 |
|---|
| Long-term forecasting | HW Wanliu (test) | 35 | Apr 1, 2026 |
|---|
| Long-term forecasting | TT (Tiantan) (test) | 35 | Apr 1, 2026 |
|---|
| Long-term forecasting | SY (Shunyi) (test) | 35 | Apr 1, 2026 |
|---|
| Long-term forecasting | DS (Dongsi) (test) | 35 | Apr 1, 2026 |
|---|
| Long-term forecasting | AZ (Aotizhongxin) (test) | 35 | Apr 1, 2026 |
|---|
| Long-term Forecasting | TT -> DS | 35 | Apr 1, 2026 |
|---|
| Long-term Forecasting | DS -> TT | 35 | Apr 1, 2026 |
|---|
| Long-term Forecasting | TT -> AZ | 35 | Apr 1, 2026 |
|---|
| Long-term Forecasting | AZ -> TT | 35 | Apr 1, 2026 |
|---|
| Long-term Forecasting | DS -> AZ | 35 | Apr 1, 2026 |
|---|
| Long-term Forecasting | AZ -> DS (test) | 35 | Apr 1, 2026 |
|---|
| Hemisphere Classification | Necker cube | 35 | Apr 1, 2026 |
|---|
| Hemisphere Classification | Mona Lisa | 35 | Apr 1, 2026 |
|---|
| Spatiotemporal Inference | Synthetic 2D Grid Matérn-3/2 kernel | 35 | Apr 1, 2026 |
|---|
| Extremely long-video understanding | LVBench | 35 | Jun 5, 2026 |
|---|
| Object Hallucination Assessment | AMBER | 35 | Mar 31, 2026 |
|---|