Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Knowledge Base Question Answering | WebQSP Freebase (test) | 60 | Jun 2, 2026 | ||
| Question Answering | CommonsenseQA (test) | 60 | Mar 4, 2026 | ||
| Office Application Question Answering | OfficeQA held-out (test) | 59 | May 25, 2026 | ||
| Web Search Question Answering | SearchQA held-out (test) | 59 | May 25, 2026 | ||
| Long-context Conversational Question Answering | LoCoMo |
| 59 |
| May 21, 2026 |
| Long-context Question Answering | LongBench | 59 | Jun 30, 2026 |
|---|
| Question Answering | ARC-E | 59 | May 19, 2026 |
|---|
| Visual Question Answering | GQA | 59 | Jun 24, 2026 |
|---|
| Question Answering | 2Wiki (test) | 59 | Jun 30, 2026 |
|---|
| Multimodal Search-based Question Answering | MMSearch | 59 | Jun 30, 2026 |
|---|
| Question Answering | WebQSP | 59 | Jul 2, 2026 |
|---|
| Question Answering | COPA | 59 | Feb 26, 2026 |
|---|
| Open-ended Video Question Answering | MSVD-QA | 59 | Feb 27, 2026 |
|---|
| End-to-end Open-Domain Question Answering | NQ (test) | 59 | May 8, 2026 |
|---|
| Open-domain Question Answering | TriviaQA open (test) | 59 | May 11, 2026 |
|---|
| Video Question Answering | Perception (test) | 59 | Feb 26, 2026 |
|---|
| Question Answering | RQA MC | 58 | May 25, 2026 |
|---|
| Multi-Hop Question Answering | MuSiQue | 58 | Apr 10, 2026 |
|---|
| Table Question Answering | AIT-QA | 58 | Apr 13, 2026 |
|---|
| Visual Question Answering | MMBench English | 58 | Jul 9, 2026 |
|---|
| Real-world Question Answering | RealWorldQA | 58 | Mar 24, 2026 |
|---|
| Boolean Question Answering | BoolQ | 57 | May 21, 2026 |
|---|
| Question Answering | MuSiQue | 57 | Jul 8, 2026 |
|---|
| Open-domain Question Answering | MusiQue out-of-domain | 57 | Apr 27, 2026 |
|---|
| Open-domain Question Answering | 2WikiMultiHopQA in-domain | 57 | Apr 27, 2026 |
|---|