Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Multimodal Language Model Unlearning | MLLMU-Bench 1.0 (Retain Set) | 30 | Jun 2, 2026 | ||
| Multimodal Language Model Unlearning | MLLMU-Bench 1.0 (test) | 30 | Jun 2, 2026 | ||
| Multimodal Language Model Unlearning | MLLMU-Bench forget set 1.0 | 30 | Jun 2, 2026 | ||
| Open-Ended Generation | MLLMU-Bench (Retain Set) | 30 | Jun 2, 2026 | ||
| Cloze Task | MLLMU-Bench (Retain Set) |
| 30 |
| Jun 2, 2026 |
| Open-Ended Generation | MLLMU-Bench (test) | 30 | Jun 2, 2026 |
|---|
| Cloze Task | MLLMU-Bench (test) | 30 | Jun 2, 2026 |
|---|
| Image Classification | Aircraft (AirC) 5-shot | 30 | Jun 2, 2026 |
|---|
| Text-to-Image Generation | DPG-Bench | 30 | Jun 12, 2026 |
|---|
| Narrative Writing | ROCStories (test) | 30 | Jun 1, 2026 |
|---|
| Privacy Evaluation | PEEP | 30 | Jun 1, 2026 |
|---|
| Privacy Evaluation | PasswordEval | 30 | Jun 1, 2026 |
|---|
| Instruction Following | Math-IF | 30 | Jun 1, 2026 |
|---|
| Instruction Following | IFEval | 30 | Jun 1, 2026 |
|---|
| Time Series Forecasting | KVPI 90-day horizon | 30 | Jun 1, 2026 |
|---|
| Proactive task suggestion | ProactiveAgent (test) | 30 | May 29, 2026 |
|---|
| Future brain state forecasting | PPMI DaTscan 12-month forecast | 30 | May 29, 2026 |
|---|
| View Synthesis | Re10K (test) | 30 | Jul 7, 2026 |
|---|
| Readback Anomaly Detection | APCP | 30 | May 29, 2026 |
|---|
| Software Engineering | SWE Lite | 30 | May 29, 2026 |
|---|
| Mathematics | MATH 500 | 30 | May 29, 2026 |
|---|
| Mathematical Reasoning | AIME 25 | 30 | May 29, 2026 |
|---|
| Online Class-Incremental Learning | Tiny-ImageNet 100 tasks (test) | 30 | May 29, 2026 |
|---|
| Graph Clustering | Photo | 30 | Jul 8, 2026 |
|---|
| Logical Inference | LogiQA | 30 | May 28, 2026 |
|---|