Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Question Answering | MedQA-USMLE (test) | 101 | Feb 26, 2026 | ||
| Question Answering | NewsQA (dev) | 101 | Feb 26, 2026 | ||
| Visual Question Answering | OKVQA (val) | 101 | Feb 26, 2026 | ||
| Open-Ended Visual Question Answering | VQA 1.0 (test-dev) | 100 | Feb 26, 2026 | ||
| Multiple Choice Question Answering | IndoCulture native prompts (test) |
| 99 |
| Feb 26, 2026 |
| Visual Question Answering | MMBench-CN | 99 | Jul 7, 2026 |
|---|
| Question Answering | NQ 8 additional samples | 98 | Jun 4, 2026 |
|---|
| Question Answering | TQA 8 additional samples | 98 | Jun 4, 2026 |
|---|
| Multi-modal Question Answering | MMMU | 98 | Jun 8, 2026 |
|---|
| Table Question Answering | TABMWP | 97 | Apr 21, 2026 |
|---|
| Question Answering | GPQA Diamond | 97 | Apr 8, 2026 |
|---|
| Medical Visual Question Answering | Pooled Medical VQA Datasets Open | 96 | Apr 6, 2026 |
|---|
| Medical Visual Question Answering | Pooled Medical VQA Datasets Closed | 96 | Apr 6, 2026 |
|---|
| Medical Visual Question Answering | SLAKE Open 1.0 (test) | 96 | Apr 6, 2026 |
|---|
| Medical Visual Question Answering | SLAKE Closed 1.0 (test) | 96 | Apr 6, 2026 |
|---|
| Medical Visual Question Answering | Pooled Medical VQA Datasets Open 5-fold CV | 96 | Apr 6, 2026 |
|---|
| Medical Visual Question Answering | Pooled Medical VQA Datasets Closed (5-fold CV) | 96 | Apr 6, 2026 |
|---|
| Medical Visual Question Answering | VQA-RAD (Closed) | 96 | Apr 6, 2026 |
|---|
| Medical Visual Question Answering | SLAKE Open | 96 | Apr 6, 2026 |
|---|
| Medical Visual Question Answering | SLAKE Closed | 96 | Apr 6, 2026 |
|---|
| Visual Question Answering | VQA-RAD (Open) | 96 | Apr 6, 2026 |
|---|
| Visual Question Answering | VQA-RAD Closed | 96 | Apr 6, 2026 |
|---|
| Visual Question Answering | VQA-Med Open | 96 | Apr 6, 2026 |
|---|
| Visual Question Answering | VQA-Med Closed | 96 | Apr 6, 2026 |
|---|
| Medical Visual Question Answering | VQA-Med Closed | 96 | Apr 6, 2026 |
|---|