Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Question Answering | bAbI (test) | 54 | Feb 26, 2026 | ||
| Medical Visual Question Answering | SLAKE closed-end | 54 | Feb 26, 2026 | ||
| Embodied Reasoning and Question Answering | ERQA | 53 | Jul 7, 2026 | ||
| Document Visual Question Answering | SlideVQA | 53 | May 15, 2026 | ||
| Visual Question Answering | OCRBench |
| 53 |
| Jul 7, 2026 |
| Multi-Hop Question Answering | HotpotQA in-domain | 53 | Jun 9, 2026 |
|---|
| Video Question Answering | VideoMME Medium | 53 | Apr 21, 2026 |
|---|
| Knowledge Base Question Answering | WebQSP | 53 | Jun 2, 2026 |
|---|
| Question Answering | CommonsenseQA IH (dev) | 53 | Feb 26, 2026 |
|---|
| Science Question Answering | SciQA-IMG | 53 | Feb 26, 2026 |
|---|
| Science Question Answering | SQA | 52 | Jun 18, 2026 |
|---|
| Question Answering | TruthfulQA | 52 | Apr 10, 2026 |
|---|
| Knowledge-Based Visual Question Answering | E-VQA Single-Hop | 52 | May 6, 2026 |
|---|
| Multiple Choice Question Answering | WinoG | 52 | Jun 29, 2026 |
|---|
| Multi-answer Question Answering | MAQA | 52 | May 12, 2026 |
|---|
| Question Answering | MMLU | 52 | Feb 26, 2026 |
|---|
| General Question Answering | NQ | 52 | Apr 16, 2026 |
|---|
| Chart-based Question Answering | ChartQA Pro | 52 | Apr 6, 2026 |
|---|
| Medical Visual Question Answering | MedXpertQA | 52 | Jun 11, 2026 |
|---|
| Question Answering | MultifieldQA | 52 | Feb 26, 2026 |
|---|
| Multiple Choice Question Answering | MMLU | 52 | May 19, 2026 |
|---|
| Question Answering | TriviaQA Wiki (val) | 52 | Mar 17, 2026 |
|---|
| Question Answering | Natural Questions | 52 | Feb 27, 2026 |
|---|
| Scientific Question Answering | GPQA | 51 | Jul 8, 2026 |
|---|
| Multiple Choice Question Answering | MMLU-PRO zero-shot | 51 | May 21, 2026 |
|---|