Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Question Answering | SciQ (train) | 36 | Feb 27, 2026 | ||
| Zero-shot Question Answering | Evaluation Suite (WinoGrande, PiQA, HellaSwag, ARC-E, ARC-C) Zero-shot | 35 | Jun 15, 2026 | ||
| Text-based Visual Question Answering | TextVQA | 35 | Jul 3, 2026 | ||
| Question Answering | NQ Poison Attack (test) | 35 | May 25, 2026 | ||
| Question Answering | NQ |
| 35 |
| May 20, 2026 |
| Question Answering | SQuAD | 35 | May 20, 2026 |
|---|
| General Visual Question Answering | GQA | 35 | Jul 1, 2026 |
|---|
| Visual Question Answering | VQA v2 | 35 | Jul 3, 2026 |
|---|
| Question Answering | TriviaQA | 35 | Apr 10, 2026 |
|---|
| Question Answering | TriviaQA | 35 | Apr 10, 2026 |
|---|
| Multiple-choice Question Answering | MMLU Medical subjects | 35 | Apr 10, 2026 |
|---|
| Multiple-choice Question Answering | MMLU Medical Subjects (test) | 35 | Apr 10, 2026 |
|---|
| Question Answering | HotpotQA | 35 | Apr 8, 2026 |
|---|
| Question Answering | MMLU | 35 | Apr 8, 2026 |
|---|
| Question Answering | StrategyQA | 35 | Apr 8, 2026 |
|---|
| Language Understanding and Question Answering | Downstream NLP Suite MMLU, BoolQ, PIQA, WinoGrande, HellaSwag, ARC-e, ARC-c, OBQA | 35 | Apr 7, 2026 |
|---|
| Question Answering | gsm8k (test) | 35 | May 15, 2026 |
|---|
| Question Answering | SQuAD | 35 | May 6, 2026 |
|---|
| Medical Visual Question Answering | SLAKE | 35 | Jun 8, 2026 |
|---|
| Single-hop Question Answering | Single-hop QA Average | 35 | Mar 19, 2026 |
|---|
| Scientific Question Answering | SciQA | 35 | May 26, 2026 |
|---|
| Question Answering | WinoGrande, HellaSwag, ARC-e, ARC-c, PIQA Average | 35 | Feb 26, 2026 |
|---|
| Multi-choice Video Question Answering | NExT-QA | 35 | Jun 16, 2026 |
|---|
| Visual Question Answering | SEED | 35 | Jun 11, 2026 |
|---|
| Visual Question Answering | Encyclopedic-VQA Full | 35 | Feb 26, 2026 |
|---|