Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Question Answering | TruthfulQA zero-shot | 30 | Mar 4, 2026 | ||
| Question Answering | SocialIQA | 30 | Mar 13, 2026 | ||
| 3D Visual Question Answering | SQA3D | 30 | Jun 9, 2026 | ||
| Visual Question Answering | VQA v2 (dev) | 30 | Feb 26, 2026 | ||
| Multi-page Document Question Answering | MP-DocVQA (test) | 30 | Feb 26, 2026 |
| Video Question Answering | MSVD (test) | 30 | Feb 27, 2026 |
|---|
| Video Question Answering | AGQA v2 (test) | 30 | Feb 26, 2026 |
|---|
| Scene Text Visual Question Answering | ST-VQA (val) | 30 | Feb 27, 2026 |
|---|
| Question Answering | XQuAD | 30 | Apr 21, 2026 |
|---|
| Open-domain Question Answering | SQuAD Open-domain 1.1 (test) | 30 | Feb 26, 2026 |
|---|
| Hierarchical Table Question Answering | MultiHiertt (test) | 30 | Feb 26, 2026 |
|---|
| Conversational Financial Question Answering | ConvFinQA (test) | 30 | Feb 26, 2026 |
|---|
| Financial Question Answering | TATQA 1.0 (test) | 30 | Feb 26, 2026 |
|---|
| Document Visual Question Answering | DUDE | 30 | Feb 26, 2026 |
|---|
| Multi-hop Question Answering | MuSiQue (dev) | 29 | Jun 23, 2026 |
|---|
| Question Answering | NQ | 29 | May 25, 2026 |
|---|
| General Knowledge Question Answering | MMLU-PRO | 29 | May 26, 2026 |
|---|
| Long-form Question Answering | Retrieval-style queries | 29 | Apr 30, 2026 |
|---|
| Long-form Question Answering | Summary-style queries | 29 | Apr 30, 2026 |
|---|
| Slide Question Answering | SlideVQA | 29 | May 15, 2026 |
|---|
| Commonsense Question Answering | Commonsense QA | 29 | May 5, 2026 |
|---|
| Medical Visual Question Answering | MMMU Med | 29 | Jul 1, 2026 |
|---|
| Question Answering | NarrativeQA LongBench | 29 | Jun 26, 2026 |
|---|
| Visual Question Answering | Colon-Bench Unprompted | 29 | Mar 27, 2026 |
|---|
| Visual Question Answering | Colon-Bench Prompted | 29 | Mar 27, 2026 |
|---|