Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Multi-Hop Question Answering | MuSiQue | 51 | May 20, 2026 | ||
| Visual Question Answering | Text-Rich Evaluation Suite (OCR Bench, Text VQA, Chart QA, Doc VQA, Info VQA, Math Vista) | 51 | May 12, 2026 | ||
| Question Answering | CommonsenseQA | 51 | Apr 20, 2026 | ||
| Question Answering | MMLU | 51 | Apr 20, 2026 | ||
| Question Answering | MATH |
| 51 |
| Apr 20, 2026 |
| Question Answering | MGSM | 51 | Apr 20, 2026 |
|---|
| Question Answering | MedMCQA | 51 | Apr 20, 2026 |
|---|
| Question Answering | SciQ | 51 | Apr 20, 2026 |
|---|
| Science Question Answering | SQA IMG | 51 | Jun 18, 2026 |
|---|
| Video Question Answering | MMVU | 51 | Mar 31, 2026 |
|---|
| General Text Question Answering | HotpotQA | 51 | May 11, 2026 |
|---|
| General Question Answering | PopQA | 51 | Apr 10, 2026 |
|---|
| Multi-Hop Question Answering | Bamboogle | 51 | Mar 10, 2026 |
|---|
| 3D Question Answering | ScanQA w/o objects (test) | 51 | Feb 26, 2026 |
|---|
| Visual Question Answering | FVQA (test) | 51 | Apr 23, 2026 |
|---|
| Visual Question Answering | COCO-QA (test) | 51 | Mar 27, 2026 |
|---|
| Visual Question Answering | HRBench 8K | 51 | Apr 15, 2026 |
|---|
| Question Answering | MMLU | 50 | Jun 2, 2026 |
|---|
| Question Answering | MedQA | 50 | Jun 2, 2026 |
|---|
| Question Answering | TriviaQA | 50 | Jun 2, 2026 |
|---|
| Multi-hop Question Answering | Average (MuSiQue, HotpotQA, 2WikiMultiHopQA, LongSeal) | 50 | Apr 28, 2026 |
|---|
| Multi-hop Question Answering | LongSeal | 50 | Apr 28, 2026 |
|---|
| Multi-hop Question Answering | HotpotQA | 50 | Apr 28, 2026 |
|---|
| Multi-hop Question Answering | MuSiQue | 50 | Apr 28, 2026 |
|---|
| Multi-Hop Question Answering | Bamboogle (test) | 50 | Jun 12, 2026 |
|---|