Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| General Question Answering | General QA NQ, TriviaQA, PopQA | 40 | May 8, 2026 | ||
| Factuality-based Question Answering | FreshQA 2025/11/24 | 40 | Feb 26, 2026 | ||
| Question Answering | TriviaQA | 40 | Feb 26, 2026 | ||
| Question Answering | TruthfulQA (test) | 40 | Jun 30, 2026 | ||
| General visual question answering | SimpleVQA | 40 | Jul 2, 2026 |
| Video Question Answering | VideoMME Overall | 40 | Jul 2, 2026 |
|---|
| 3D Situated Question Answering | SQA3D (test) | 40 | Feb 26, 2026 |
|---|
| Video Question Answering | TVQA | 40 | Feb 26, 2026 |
|---|
| Knowledge Base Question Answering | GrailQA | 40 | Jun 2, 2026 |
|---|
| End-to-end Open-Domain Question Answering | TriviaQA (test) | 40 | Feb 26, 2026 |
|---|
| Visual Question Answering | TextVQA v1.0 (test) | 40 | Apr 10, 2026 |
|---|
| Question Answering | NewsQA (test) | 40 | Jun 12, 2026 |
|---|
| Code-Switched Question Answering | CodeMixQA | 39 | Jun 19, 2026 |
|---|
| Science Question Answering | ScienceQA | 39 | Jun 24, 2026 |
|---|
| Question Answering | ARC-e | 39 | Jun 26, 2026 |
|---|
| Short-answer Question Answering | HotPotQA | 39 | Jun 12, 2026 |
|---|
| Cultural Visual Question Answering | CVQA (eval) | 39 | Apr 21, 2026 |
|---|
| Question Answering | MetaQA 3-hop | 39 | Apr 24, 2026 |
|---|
| Question Answering | MetaQA 2-hop | 39 | Apr 24, 2026 |
|---|
| Question Answering | NaturalQA (test) | 39 | Jul 8, 2026 |
|---|
| Embodied Visual Question Answering | ERQA | 39 | Jun 11, 2026 |
|---|
| Question Answering | HotpotQA (test) | 39 | Feb 26, 2026 |
|---|
| Text-based Visual Question Answering | TextVQA (test) | 39 | Jun 15, 2026 |
|---|
| Generative Question Answering | Bolmo Evaluation Suite GenQA 7B | 39 | Apr 7, 2026 |
|---|
| Expert-level Question Answering | GPQA Diamond | 39 | Jun 1, 2026 |
|---|