Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Multiple-choice Question Answering | MMLU-Pro Law | 40 | May 28, 2026 | ||
| Multiple-choice Question Answering | MMLU-Pro Chem. | 40 | May 28, 2026 | ||
| Question Answering | QA | 40 | May 26, 2026 | ||
| Question Answering | TriviaQA | 40 | May 20, 2026 | ||
| Selective Question Answering | TriviaQA | 40 | May 20, 2026 | ||
| Medical Visual Question Answering (Multiple-Choice) |
| MIMIC (test) |
| 40 |
| May 12, 2026 |
| Medical Visual Question Answering (Multiple-Choice) | IU-XRay (test) | 40 | May 12, 2026 |
|---|
| Medical Visual Question Answering (True/False) | MIMIC (test) | 40 | May 12, 2026 |
|---|
| Medical Visual Question Answering (True/False) | IU-XRay (test) | 40 | May 12, 2026 |
|---|
| LLM Serving and Question Answering | MultiHopRAG hot0.7 (test) | 40 | May 12, 2026 |
|---|
| Biomedical Question Answering | PubMedQA | 40 | Apr 28, 2026 |
|---|
| Question Answering | PIQA (test) | 40 | May 12, 2026 |
|---|
| Medical Visual Question Answering | Pooled Medical VQA Closed-ended | 40 | Apr 6, 2026 |
|---|
| Question Answering | CoQA alpha = 0.25 (test) | 40 | Feb 26, 2026 |
|---|
| Question Answering | CoQA alpha = 0.25 (filtering stage) | 40 | Feb 26, 2026 |
|---|
| Text Visual Question Answering (Open Ended) | RIO-Bench Text-VQA (OE) Attack | 40 | Feb 26, 2026 |
|---|
| Text Visual Question Answering (Open Ended) | RIO-Bench Text-VQA (OE) Clean | 40 | Feb 26, 2026 |
|---|
| Object Visual Question Answering (Multiple Choice) | RIO-Bench Obj-VQA (MC) (Attack) | 40 | Feb 26, 2026 |
|---|
| Object Visual Question Answering (Multiple Choice) | RIO-Bench Obj-VQA (MC) Clean | 40 | Feb 26, 2026 |
|---|
| Open-Domain Question Answering | TriviaQA | 40 | Feb 26, 2026 |
|---|
| Open-Domain Question Answering | NaturalQuestions (NQ) | 40 | Feb 26, 2026 |
|---|
| Document Question Answering | MMLongBench-Doc | 40 | Jun 30, 2026 |
|---|
| Question Answering | NarrativeQA | 40 | Feb 27, 2026 |
|---|
| Table Question Answering | TableBench | 40 | Feb 26, 2026 |
|---|
| Table Question Answering | Penguins in a Table | 40 | Feb 26, 2026 |
|---|