Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Question Answering | TriviaQA (test) | 28 | Jun 30, 2026 | ||
| Question Answering | NQ (test) | 28 | Jun 30, 2026 | ||
| Question Answering | GAIA (test) | 28 | Jun 30, 2026 | ||
| Question Answering | FRAMES (test) | 28 | Jun 30, 2026 | ||
| Question Answering | HotpotQA (test) | 28 | Jun 30, 2026 | ||
| Multimodal Visual Question Answering and Reasoning | LLaVA Evaluation Suite (GQA, SQA-IMG, VQA-Text, POPE, MME, MMBench-EN, MMBench-CN, MM-Vet) 1.5 |
| 28 |
| Jun 26, 2026 |
| Multimodal Understanding and Question Answering | LLaVA-NeXT Evaluation Suite (GQA, SQA-IMG, VQA-Text, POPE, MME, MMB-EN, MMB-CN, MMVet) 13B (test) | 28 | Jun 26, 2026 |
|---|
| Multimodal Question Answering and Reasoning | LMM Evaluation Suite (GQA, SQA-IMG, VQA-Text, POPE, MME, MMBench, MM-Vet) (test val) | 28 | Jun 26, 2026 |
|---|
| Navigation Question Answering | RAVEN-QA Habitat Simulation Tasks | 28 | Jun 25, 2026 |
|---|
| Navigation Question Answering | RAVEN-QA Real-World Robot Tasks | 28 | Jun 25, 2026 |
|---|
| Multi-hop dynamic question answering | BrowseComp-Plus (test) | 28 | Jun 18, 2026 |
|---|
| Multi-hop Question Answering | 2WikiMultiHopQA | 28 | Jul 8, 2026 |
|---|
| Chart Question Answering | ChartQA | 28 | Jul 1, 2026 |
|---|
| Science Question Answering | GPQA | 28 | May 19, 2026 |
|---|
| Video Visual Question Answering | VSI-Bench | 28 | May 26, 2026 |
|---|
| Chart Question Answering | ChartQA | 28 | Jun 17, 2026 |
|---|
| Question Answering and Commonsense Reasoning | NLP Benchmark Suite Zero-shot (HellaSwag, RACE, PIQA, WinoGrande, ARC, OBQA) (test) | 28 | May 14, 2026 |
|---|
| Knowledge Graph Question Answering | WebQSP | 28 | May 13, 2026 |
|---|
| Question Answering | In-Domain Average | 28 | May 12, 2026 |
|---|
| Factuality Question Answering | TruthfulQA | 28 | May 11, 2026 |
|---|
| Question Answering | CoQA | 28 | May 8, 2026 |
|---|
| General Visual Question Answering | VQA v2 | 28 | Jun 23, 2026 |
|---|
| Reasoning Question Answering | FinQA (test) | 28 | May 22, 2026 |
|---|
| Multimodal Question Answering | M2RAG | 28 | Apr 28, 2026 |
|---|
| Question Answering | TSpecLLM | 28 | Apr 24, 2026 |
|---|