Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Medical Question Answering | MedXpertQA | 31 | Mar 31, 2026 | ||
| Question Answering | Medical | 31 | Jun 16, 2026 | ||
| Visual Question Answering | GQA v1.0 (test) | 31 | Mar 24, 2026 | ||
| Question Answering | TriviaQA Gen (test) | 31 | Feb 26, 2026 | ||
| Medical Visual Question Answering | RadImageNet-VQA | 31 | Jul 1, 2026 | ||
| Multiple Choice Question Answering |
| Average (OBQA, ARC, Riddle, PQA) |
| 31 |
| Feb 26, 2026 |
| Multiple Choice Question Answering | RiddleSense | 31 | Feb 26, 2026 |
|---|
| Multi-Hop Question Answering | HotpotQA | 31 | Feb 26, 2026 |
|---|
| Multi-hop Question Answering | HotpotQA (val) | 31 | Mar 17, 2026 |
|---|
| 3D Visual Question Answering | ScanQA | 31 | Jul 8, 2026 |
|---|
| Visual Question Answering | InfoVQA | 31 | Mar 25, 2026 |
|---|
| Multimodal Science Question Answering | ScienceQA v1.0 (test) | 31 | Feb 26, 2026 |
|---|
| Visual Question Answering | VQA v2 (std) | 31 | Feb 26, 2026 |
|---|
| Video Question Answering | iVQA (test) | 31 | Feb 27, 2026 |
|---|
| Video Question Answering | MSRVTT-MC (test) | 31 | Feb 26, 2026 |
|---|
| Question Answering (Q&A) | COMA Evaluation Suite | 30 | Jun 23, 2026 |
|---|
| Truthful Question Answering | TruthfulQA | 30 | Jun 11, 2026 |
|---|
| Multi-hop Question Answering | MuSiQue | 30 | Jun 2, 2026 |
|---|
| Multi-hop Question Answering | 2WikiMultiHopQA | 30 | Jun 2, 2026 |
|---|
| General Knowledge Question Answering | MMLU | 30 | May 28, 2026 |
|---|
| Multi-hop Question Answering | SQuAD | 30 | May 28, 2026 |
|---|
| Question Answering | NQ (test) | 30 | May 22, 2026 |
|---|
| Question Answering | TriviaQA LongBench | 30 | May 22, 2026 |
|---|
| Knowledge Base Question Answering | CWQ | 30 | Jun 2, 2026 |
|---|
| Closed-domain QA | BoolQ | 30 | May 15, 2026 |
|---|