Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Multi-label classification | yeast | 32 | May 12, 2026 | ||
| Multi-label classification | scene | 32 | May 12, 2026 | ||
| Multi-label classification | birds | 32 | May 12, 2026 | ||
| Multi-label classification | cal500 | 32 | May 12, 2026 | ||
| Classification | YouTube Faces |
| 32 |
| May 12, 2026 |
| Tool-augmented agent execution | MCP-Bench | 32 | Jun 16, 2026 |
|---|
| Mathematical Reasoning | AMC 2024 | 32 | Jun 4, 2026 |
|---|
| Adversarial Attack | Harmful Query Stress Test | 32 | May 12, 2026 |
|---|
| 3D Relocalization | Building-Corridor Scene | 32 | May 11, 2026 |
|---|
| Signal Peptide prediction | SignalP | 32 | May 11, 2026 |
|---|
| Subcellular Localization prediction | Subcellular Localization | 32 | May 11, 2026 |
|---|
| Metal Ion binding prediction | Metal Ion | 32 | May 11, 2026 |
|---|
| Solubility Prediction | DeepSol | 32 | May 11, 2026 |
|---|
| Variant Effect Prediction | Variant Effect | 32 | May 11, 2026 |
|---|
| Stability Prediction | Biomap | 32 | May 11, 2026 |
|---|
| Fluorescence Prediction | TAPE | 32 | May 11, 2026 |
|---|
| Catalytic Activity Prediction | Enzyme | 32 | May 11, 2026 |
|---|
| Disorder Prediction | CheZoD | 32 | May 11, 2026 |
|---|
| Machine Translation | WMT-23 | 32 | May 11, 2026 |
|---|
| Question Answering | NQ | 32 | May 11, 2026 |
|---|
| Mathematical Reasoning | MATH 500 | 32 | May 11, 2026 |
|---|
| Long-form Factuality | FActScore | 32 | Jun 26, 2026 |
|---|
| Instruction Fine-tuning | MetaMathQA Fine-tuning Evaluation Suite (ARC-C, PIQA, MMLU, HE, GSM8K) (test) | 32 | May 8, 2026 |
|---|
| Prefill KV-cache memory measurement | TULU 3 (dev) | 32 | May 8, 2026 |
|---|
| Prefill | Stage-aware Prefill | 32 | May 8, 2026 |
|---|