Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| General Language Understanding | LAMBADA, ARC-C, HellaSwag, BoolQ, MMLU, GSM8K Average | 56 | Jun 23, 2026 | ||
| Human alignment evaluation | LaMP Citation Identification, Movie Tagging, and Product Rating (test) | 56 | Jun 16, 2026 | ||
| Credit risk prediction | Real-world credit dataset | 56 | Jun 11, 2026 | ||
| Motion Retargeting | Human-to-Unitree G1 Retargeting (test) | 56 | Jun 4, 2026 | ||
| General LLM Capability | General Capability Suite MMLU, AlpacaEval, GSM8K, MATH, HumanEval |
| 56 |
| Jun 2, 2026 |
| Safety Evaluation | Safety Suite AdvBench, PKU-SafeRLHF, HarmBench, JailbreakBench, SORRY-Bench, HarmfulQA, ALERT | 56 | Jun 2, 2026 |
|---|
| Question Answering | NQ | 56 | Jun 2, 2026 |
|---|
| Safety Detection | AgentHazard Strongest | 56 | Jun 2, 2026 |
|---|
| Fairness-aware Conformal Prediction | Fitzpatrick | 56 | Jun 2, 2026 |
|---|
| Semantic Segmentation | RUGD (test) | 56 | May 28, 2026 |
|---|
| Mathematical Reasoning | Mathematical Reasoning Suite AIME 2024, AIME 2025, AMC 2023, HMMT Feb 2025, OlymMath (test) | 56 | May 27, 2026 |
|---|
| Hallucination Detection | PsiloQA | 56 | May 27, 2026 |
|---|
| Zero-shot Question Answering | QA Suite (PIQA, Winogrande, HellaSwag, ARC-E, ARC-C, LAMBADA) Zero-shot | 56 | May 21, 2026 |
|---|
| Web Agent | WebArena | 56 | Jun 24, 2026 |
|---|
| Class-level Continual Learning | 2Wiki | 56 | May 19, 2026 |
|---|
| Class-level Continual Learning | TACO | 56 | May 19, 2026 |
|---|
| Class-level Continual Learning | MATH | 56 | May 19, 2026 |
|---|
| Class-level Continual Learning | MMLU-PRO | 56 | May 19, 2026 |
|---|
| Deceptive commitment prediction | Deceptive commitment prediction Leave-one-environment-out transfer (held-out fifth) | 56 | May 19, 2026 |
|---|
| Honest commitment prediction | Commitment prediction dataset (Leave-one-environment-out OOD split) | 56 | May 19, 2026 |
|---|
| Adversarial Attack | CIFAR-100 | 56 | May 21, 2026 |
|---|
| Time Series Classification | Worms | 56 | May 18, 2026 |
|---|
| Time series classification | Motor | 56 | May 18, 2026 |
|---|
| Time series classification | Ethanol | 56 | May 18, 2026 |
|---|
| Density Estimation | Noisy torus distributions | 56 | May 14, 2026 |
|---|