Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Visual Question Answering | VQA lite v2 | 55 | Jun 11, 2026 | ||
| Question Answering | ARC Easy | 55 | Jun 2, 2026 | ||
| Audio Question Answering | MMAR | 55 | Jun 9, 2026 | ||
| Question Answering | HQA | 55 | Mar 11, 2026 | ||
| Medical Visual Question Answering | PathVQA (test) |
| 55 |
| May 26, 2026 |
| Table Question Answering | WikiSQL | 55 | Jun 30, 2026 |
|---|
| 3D Question Answering | ScanQA w/ objects (test) | 55 | Feb 26, 2026 |
|---|
| Open-domain Question Answering | WebQuestions (WebQ) (test) | 55 | Feb 26, 2026 |
|---|
| Visual Question Answering | VQA (val) | 55 | Feb 27, 2026 |
|---|
| Table Question Answering | WikiSQL (test) | 55 | Feb 26, 2026 |
|---|
| Document Visual Question Answering | DocVQA | 54 | Jul 7, 2026 |
|---|
| Question Answering | ClimaQA | 54 | Apr 30, 2026 |
|---|
| Multi-task Question Answering | ARC, OBQA, and Riddle Combined (test) | 54 | Apr 21, 2026 |
|---|
| Question Answering | MuSiQue | 54 | May 29, 2026 |
|---|
| Multi-turn Visual Question Answering | ConvBench | 54 | Mar 24, 2026 |
|---|
| Medical Question Answering | MedMCQA | 54 | Mar 19, 2026 |
|---|
| Multi-hop Question Answering | HotPotQA | 54 | Mar 13, 2026 |
|---|
| Question Answering | TruthfulQA MC1 | 54 | Mar 16, 2026 |
|---|
| Long-context Question Answering | 2WikiMultiHopQA (Out-Of-Distribution) | 54 | Feb 26, 2026 |
|---|
| Knowledge-based Visual Question Answering | INFOSEEK Unseen Question | 54 | Jun 24, 2026 |
|---|
| Multi-Hop Question Answering | HotpotQA | 54 | Apr 21, 2026 |
|---|
| General Question Answering | TriviaQA | 54 | Apr 10, 2026 |
|---|
| Video Question Answering | Video-ChatGPT | 54 | Jun 12, 2026 |
|---|
| Video Question Answering | STAR (test) | 54 | May 28, 2026 |
|---|
| Long Form Question Answering | ELI5 (test) | 54 | Feb 27, 2026 |
|---|