Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Question Answering | SciQA (test) | 30 | May 15, 2026 | ||
| Question Answering | HotpotQA | 30 | May 15, 2026 | ||
| Multilingual Extractive Question Answering | Multilingual QA matrix (JSQuAD, TyDi-QA, and XQuAD) binary feedback at Q ≈ 10^6 (test) | 30 | May 12, 2026 | ||
| Question Answering | MultiFieldQA-zh | 30 | May 8, 2026 | ||
| Surgical Video Question Answering | REAL-Colon-VQA (Out-of-template) |
| 30 |
| Jun 17, 2026 |
| Surgical Video Question Answering | REAL-Colon-VQA In-template | 30 | Jun 17, 2026 |
|---|
| Question Answering | MetaQA 1-hop | 30 | Apr 15, 2026 |
|---|
| Question Answering | CWQ | 30 | Jun 16, 2026 |
|---|
| Vision Question Answering | OKVQA | 30 | Apr 10, 2026 |
|---|
| Question Answering | NQ | 30 | Apr 10, 2026 |
|---|
| Question Answering | MS-MARCO | 30 | Apr 10, 2026 |
|---|
| Question Answering | HotpotQA | 30 | Apr 10, 2026 |
|---|
| Visual Question Answering | Infrared-COCO (test) | 30 | Apr 6, 2026 |
|---|
| Visual Question Answering | Pooled medical VQA dataset Open | 30 | Apr 6, 2026 |
|---|
| Visual Question Answering | Pooled medical VQA dataset Closed | 30 | Apr 6, 2026 |
|---|
| Medical Question Answering | Medec | 30 | Apr 2, 2026 |
|---|
| Medical Question Answering | MedCalc-Bench | 30 | Apr 2, 2026 |
|---|
| Question Answering | MetaQA | 30 | Apr 1, 2026 |
|---|
| Question Answering | FactKG | 30 | Apr 1, 2026 |
|---|
| Question Answering | HotpotQA Distractor | 30 | Apr 1, 2026 |
|---|
| Question Answering | MMLU | 30 | Mar 25, 2026 |
|---|
| Question Answering | GPQA | 30 | Mar 25, 2026 |
|---|
| Scientific Question Answering | GPQA | 30 | Mar 25, 2026 |
|---|
| Medical Question Answering | MedQA | 30 | Mar 20, 2026 |
|---|
| Financial Question Answering | FinQA | 30 | May 18, 2026 |
|---|