Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Membership Inference Attack | HackerNews Pythia | 36 | Feb 26, 2026 | ||
| Membership Inference Attack | DM Math Pythia | 36 | Feb 26, 2026 | ||
| Membership Inference Attack | arXiv Pythia | 36 | Feb 26, 2026 | ||
| Membership Inference Attack | PubMed Pythia | 36 | Feb 26, 2026 | ||
| Membership Inference Attack | Pile CC Pythia | 36 |
| Feb 26, 2026 |
| Membership Inference Attack | GitHub Pythia | 36 | Feb 26, 2026 |
|---|
| Membership Inference Attack | Wikipedia Pythia | 36 | Feb 26, 2026 |
|---|
| Membership Inference | GitHub Pythia (train) | 36 | Feb 26, 2026 |
|---|
| Membership Inference | Wikipedia Pythia (train) | 36 | Feb 26, 2026 |
|---|
| Semantic Hallucination Detection | PAWS | 36 | Feb 26, 2026 |
|---|
| Maximum Clique | RB500 MC instances (static) | 36 | Feb 26, 2026 |
|---|
| General Knowledge Reasoning | MMLU-Pro | 36 | Apr 8, 2026 |
|---|
| Contributor Attribution | ArtBench Post-Impressionism | 36 | Feb 26, 2026 |
|---|
| SAE steering | Neutral prefixes dataset | 36 | Feb 26, 2026 |
|---|
| Knowledge Recovery | WMDP-Bio 100-sample subset | 36 | Feb 26, 2026 |
|---|
| Pricing optimization | Philippines cocoa liquor dataset (test) | 36 | Feb 26, 2026 |
|---|
| Safety Alignment | PKU-SafeRLHF 30K (IID) | 36 | Feb 26, 2026 |
|---|
| Safety Evaluation | XSTest (test) | 36 | Jun 11, 2026 |
|---|
| OOD detection | ImageNet (OOD) with CIFAR10 (ID) | 36 | Feb 26, 2026 |
|---|
| Causal Discovery | Synthetic (n=100, |E|=400, sample size=1000) | 36 | Feb 26, 2026 |
|---|
| Human Activity Recognition | CMDFall | 36 | Feb 26, 2026 |
|---|
| Variational Quantum Eigensolver | Noisy Transverse-Field Ising Hamiltonians | 36 | Feb 26, 2026 |
|---|
| Image Classification | CINIC-10 Dir(0.01), 50 clients, 20% participation | 36 | Feb 26, 2026 |
|---|
| Language Model Alignment Evaluation | Arena-Hard v0.1 | 36 | Feb 26, 2026 |
|---|
| Learning Curve Extrapolation | LCBench (test) | 36 | Feb 26, 2026 |
|---|