Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Question Answering | TabMWP | 48 | Jun 11, 2026 | ||
| Safe Reinforcement Learning | Safety-Gymnasium PointPush (OSRL) | 48 | Jun 9, 2026 | ||
| Safe Reinforcement Learning | Safety-Gymnasium AntVelocity OSRL | 48 | Jun 9, 2026 | ||
| Safe Reinforcement Learning | Safety-Gymnasium CarCircle OSRL | 48 | Jun 9, 2026 | ||
| Safe Reinforcement Learning | Safety-Gymnasium PointGoal OSRL |
| 48 |
| Jun 9, 2026 |
| Text Classification | AG News (Fourth Session Transition) | 48 | Jun 9, 2026 |
|---|
| Text Classification | AG News (Second Session Transition) | 48 | Jun 9, 2026 |
|---|
| Semantic Textual Similarity | STS (Semantic Textual Similarity) Benchmark Suite | 48 | Jun 5, 2026 |
|---|
| Adversarial Attack Transfer | 388 harmful behaviors | 48 | Jun 5, 2026 |
|---|
| Image Denoising | Standard Images Foreman, Lena, House, Fingerprint, Peppers (test) | 48 | Jun 5, 2026 |
|---|
| LLM Decoding | Long Context 32K | 48 | Jun 4, 2026 |
|---|
| Question Answering | 8-concept | 48 | Jun 4, 2026 |
|---|
| Dynamic link prediction | UCI (transductive) | 48 | Jun 4, 2026 |
|---|
| Financial Auditing | FinMR | 48 | Jun 4, 2026 |
|---|
| Financial Auditing | Financial Audit Evaluation Set 67 cases (test) | 48 | Jun 4, 2026 |
|---|
| Graph Alignment | Dense Erdős-Rényi graphs (average degree 80) | 48 | Jun 2, 2026 |
|---|
| Graph Alignment | Sparse Erdős-Rényi graphs average degree 4 | 48 | Jun 2, 2026 |
|---|
| Medical Image Classification | PATHMNIST | 48 | Jun 2, 2026 |
|---|
| Regression | Crime Incidence | 48 | Jun 2, 2026 |
|---|
| Non-targeted Black-box Attack | MIT Places365 (val) | 48 | Jun 1, 2026 |
|---|
| Targeted Black-box Adversarial Attack | Places365 | 48 | Jun 1, 2026 |
|---|
| Non-targeted Black-box Adversarial Attack | Places365 | 48 | Jun 1, 2026 |
|---|
| Two-sample testing | Gravitational-lensing benchmark (test) | 48 | Jun 1, 2026 |
|---|
| Visual Place Recognition | Pittsburgh30k | 48 | Jun 1, 2026 |
|---|
| Corpus Composition Inference | LLMScan Coarse-Grained 1.0 (test) | 48 | May 29, 2026 |
|---|