Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Question Answering | MMLU | 46 | Mar 10, 2026 | ||
| Visual Question Answering | LLaVA Evaluation Suite GQA, MMB, MMMU, MME, VQAv2, VQAtext, POPE, SQA, SEED, MMVet 1.5 7B (various) | 46 | Feb 26, 2026 | ||
| Question Answering | SearchQA | 46 | Jun 2, 2026 | ||
| Question Answering | TriviaQA | 46 | Feb 26, 2026 | ||
| Long-video Question Answering | MLVU | 46 | Jun 8, 2026 |
| Long-video Question Answering | Long VideoBench (val) | 46 | Jun 8, 2026 |
|---|
| Infographic Visual Question Answering | InfoVQA (test) | 46 | Jun 2, 2026 |
|---|
| Visual Question Answering | CLEVR 1.0 (test) | 46 | Feb 26, 2026 |
|---|
| Question Answering | PaperQA | 45 | Jul 7, 2026 |
|---|
| Question Answering | HotpotQA PoisonedRAG (test) | 45 | May 20, 2026 |
|---|
| Question Answering | HotpotQA Clean (test) | 45 | May 20, 2026 |
|---|
| Retrieval-Augmented Question Answering | NQ | 45 | May 20, 2026 |
|---|
| Long-context Question Answering | LongBench N=162 | 45 | May 19, 2026 |
|---|
| Question Answering | ARC | 45 | Jun 4, 2026 |
|---|
| Question Answering | Riddle (test) | 45 | Apr 21, 2026 |
|---|
| Question Answering | GPQA Diamond | 45 | Jun 12, 2026 |
|---|
| Visual Question Answering | VQA v2 | 45 | May 25, 2026 |
|---|
| Multiple Choice Question Answering | PathMMU (val) | 45 | Jun 9, 2026 |
|---|
| Question Answering and Commonsense Reasoning | Short-context benchmarks ARC-C, ARC-E, PIQA, Winogrande, HellaSwag | 45 | Apr 21, 2026 |
|---|
| Multi-hop Multiple-choice Question Answering | T2S-Bench-MR 1.0 (test) | 45 | Mar 5, 2026 |
|---|
| Fact-based Question Answering | FVQA (test) | 45 | Jun 5, 2026 |
|---|
| Question Answering | TriviaQA (TQA) (test) | 45 | Feb 26, 2026 |
|---|
| Question Answering | Natural Questions (NQ) (test) | 45 | Feb 26, 2026 |
|---|
| Table Question Answering | TAT-QA | 45 | Apr 7, 2026 |
|---|
| Question Answering | DisambiguationQA | 45 | Feb 26, 2026 |
|---|