Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Multiple Choice Non-STEM Question Answering | OlmoBaseEval MC Non-STEM (MMLU Humanities/Social Sci, CSQA, PiQA, SocialIQA, CoQA, DROP, Jeopardy, NaturalQs, SQuAD) | 34 | Apr 7, 2026 | ||
| Multiple-choice Question Answering | TruthfulQA Multiple-choice | 34 | Jun 4, 2026 | ||
| Question Answering | MuSiQue | 34 | Mar 4, 2026 | ||
| Multi-hop Question Answering | 2Wiki (test) | 34 | Jun 16, 2026 | ||
| Visual Question Answering |
| SQA-I |
| 34 |
| Apr 24, 2026 |
| Video Question Answering | Video-MME Long Duration 1.0 | 34 | Feb 26, 2026 |
|---|
| Extractive Question Answering | SQuAD 2.0 | 34 | Feb 26, 2026 |
|---|
| Cross-lingual Question Answering | MLQA v1.0 (test) | 34 | Feb 26, 2026 |
|---|
| Question Answering | SQuAD 2.0 (test) | 34 | Feb 26, 2026 |
|---|
| Question Answering | HotpotQA distractor setting (test) | 34 | Jun 12, 2026 |
|---|
| Chart Visual Question Answering | ChartBench 1.0 (test) | 33 | Jun 11, 2026 |
|---|
| Multiple Choice Question Answering | HellaSwag | 33 | May 29, 2026 |
|---|
| Multiple Choice Question Answering | ARC Challenge | 33 | May 29, 2026 |
|---|
| Chart Question Answering | CharXiv | 33 | May 27, 2026 |
|---|
| Text-based Visual Question Answering | TextVQA | 33 | May 26, 2026 |
|---|
| Visual Question Answering | XLRS-Bench L-3 Capability (test) | 33 | May 11, 2026 |
|---|
| Medical Visual Question Answering | SLAKE | 33 | Apr 23, 2026 |
|---|
| Graduate-Level Question Answering | GPQA Diamond | 33 | May 29, 2026 |
|---|
| Question Answering | MuSiQue | 33 | Jun 29, 2026 |
|---|
| Multi-turn Visual Question Answering | MT-GQA | 33 | Mar 24, 2026 |
|---|
| Multimodal Question Answering | MMBench English | 33 | Jun 26, 2026 |
|---|
| Visual Question Answering | NuscenesQA | 33 | May 1, 2026 |
|---|
| Visual Question Answering | TextVQA | 33 | Feb 26, 2026 |
|---|
| Embodied Question Answering | A-EQA | 33 | Jun 24, 2026 |
|---|
| Medical Question Answering | MedicalQA | 33 | Feb 26, 2026 |
|---|