Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Question Answering | TyDi QA | 43 | Feb 26, 2026 | ||
| Question Answering | HotpotQA (dev) | 43 | May 19, 2026 | ||
| Video Question Answering | TVQA (test-public) | 43 | Feb 26, 2026 | ||
| Multiple-choice Question Answering | AQuA | 43 | May 19, 2026 | ||
| Question Answering | CMB Exam | 42 | Jun 23, 2026 | ||
| Question Answering | MedQA |
| 42 |
| Jun 23, 2026 |
| Question Answering | OpenBookQA | 42 | Jun 12, 2026 |
|---|
| Question Answering | TriviaQA | 42 | Jun 11, 2026 |
|---|
| Question Answering | FairytaleQA (test) | 42 | Jun 5, 2026 |
|---|
| Question Answering | STAGE Main Results | 42 | Jun 5, 2026 |
|---|
| Question Answering | MuSiQue (held-out) | 42 | Jun 2, 2026 |
|---|
| Visual Question Answering (VQA) | MLLMU-Bench 5% (forget) | 42 | May 18, 2026 |
|---|
| Question Answering | BoolQ -> SQuAD -> AdversarialQA (test) | 42 | May 14, 2026 |
|---|
| Question Answering | MMLU Pro.Med. | 42 | May 8, 2026 |
|---|
| Multiple Choice Question Answering | ConFiQA MC | 42 | Apr 14, 2026 |
|---|
| Science and Knowledge Question Answering | Science and Knowledge Aggregate: SciQ, ARC-Easy, MedMCQA (test) | 42 | Mar 24, 2026 |
|---|
| Visual Question Answering | OKVQA | 42 | Mar 16, 2026 |
|---|
| Visual Question Answering | VQA v2 | 42 | Mar 16, 2026 |
|---|
| Multiple-choice Question Answering | MedMCQA | 42 | May 12, 2026 |
|---|
| Question Answering | NQ | 42 | Jun 12, 2026 |
|---|
| Question Answering | MultiExpertQA-P Base and Fine-tuned (FT) | 42 | Feb 26, 2026 |
|---|
| Question Answering | AbsR | 42 | Feb 26, 2026 |
|---|
| Question Answering | Probe 2 1.0 (test) | 42 | Feb 26, 2026 |
|---|
| Question Answering | En.QA | 42 | Jun 11, 2026 |
|---|
| Question Answering | CSQA | 42 | Jun 4, 2026 |
|---|