Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Mathematical Problem Solving | LiveMath held-out (test) | 59 | May 25, 2026 | ||
| Office Application Question Answering | OfficeQA held-out (test) | 59 | May 25, 2026 | ||
| Spreadsheet Manipulation and Reasoning | SpreadsheetBench held-out (test) | 59 | May 25, 2026 | ||
| Web Search Question Answering | SearchQA held-out (test) | 59 | May 25, 2026 | ||
| Zero-shot Accuracy | 6-task zero-shot (MMLU, PIQA, ARC-E, ARC-C, Winogrande, OBQA) |
| 59 |
| May 19, 2026 |
| Online Shopping | WebShop (test) | 59 | May 29, 2026 |
|---|
| Agentic reasoning | WebShop | 59 | Jun 17, 2026 |
|---|
| Automatic tree ring detection | P. taeda | 59 | May 11, 2026 |
|---|
| Long-context Conversational Question Answering | LoCoMo | 59 | May 21, 2026 |
|---|
| Truthfulness Evaluation | TruthfulQA | 59 | Apr 23, 2026 |
|---|
| Harmfulness Detection | OpenAI Moderation | 59 | Jun 23, 2026 |
|---|
| Agentic tool-use | Tau2-Bench | 59 | Jun 2, 2026 |
|---|
| Node Classification | Citeseer | 59 | May 14, 2026 |
|---|
| Long-context Question Answering | LongBench | 59 | Jun 30, 2026 |
|---|
| Mortality Prediction | MIMIC-III | 59 | Jun 5, 2026 |
|---|
| Mathematical Reasoning | College Math | 59 | May 26, 2026 |
|---|
| Information Retrieval | NIAH (test) | 59 | Apr 8, 2026 |
|---|
| Question Answering | ARC-E | 59 | May 19, 2026 |
|---|
| Time Series Anomaly Detection | PSM | 59 | Jun 18, 2026 |
|---|
| Speech Enhancement | Ad-hoc microphone array 8-channel (test) | 59 | Mar 27, 2026 |
|---|
| WSI Classification | TCGA-Lung | 59 | Jun 11, 2026 |
|---|
| Mathematical Reasoning | MATH-500 | 59 | May 11, 2026 |
|---|
| Visual Question Answering | GQA | 59 | Jun 24, 2026 |
|---|
| Multi-modal Benchmarking | MMBench Chinese | 59 | Jul 1, 2026 |
|---|
| Classification | heart | 59 | May 12, 2026 |
|---|