Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Fine-grained Perception | HR-Bench 8K | 38 | Jul 7, 2026 | ||
| Code Generation | MBPP+ | 38 | Jun 30, 2026 | ||
| LiDAR rendering | Simulated batched multi-environments | 38 | Jun 23, 2026 | ||
| Text-to-SQL | Spider | 38 | Jul 3, 2026 | ||
| Harmlessness Evaluation | LINGUASAFE (test) | 38 | Jun 16, 2026 | ||
| Protein-Ligand Binding Affinity Prediction |
|---|
| PDBbind 2019 (holdout set) |
| 38 |
| Jun 15, 2026 |
| Scientific Manuscript Reviewing | ICLR 2026 (test) | 38 | Jun 12, 2026 |
|---|
| Commonsense Reasoning | WinoGrande (WG) | 38 | Jul 3, 2026 |
|---|
| Vehicle Re-identification | DN-Wild | 38 | Jun 11, 2026 |
|---|
| Vehicle Re-identification | DN-348 | 38 | Jun 11, 2026 |
|---|
| Question Answering | ESGenius | 38 | Jun 11, 2026 |
|---|
| Out-of-Domain Generalization | Out-of-Domain Generalization Suite Aggregate | 38 | Jun 9, 2026 |
|---|
| Multimodal Clinical Reasoning | AgentClinic_M offline (test) | 38 | Jun 9, 2026 |
|---|
| Multimodal Reasoning | MMMU-Pro offline (test) | 38 | Jun 9, 2026 |
|---|
| Clinical Reasoning | AgentClinic_T offline (test) | 38 | Jun 9, 2026 |
|---|
| Medical Question Answering | MediQ offline (test) | 38 | Jun 9, 2026 |
|---|
| Medical Reasoning | MedJourney offline (test) | 38 | Jun 9, 2026 |
|---|
| Multimodal Reasoning | MMMU (offline) | 38 | Jun 9, 2026 |
|---|
| Clinical Question Answering | MedXpertQA Multimodal modality (offline) | 38 | Jun 9, 2026 |
|---|
| Clinical Question Answering | LiveClin Multimodal (offline) | 38 | Jun 9, 2026 |
|---|
| Clinical Question Answering | LiveMedBench (offline) | 38 | Jun 9, 2026 |
|---|
| Clinical Question Answering | HealthBench (offline) | 38 | Jun 9, 2026 |
|---|
| Clinical Question Answering | MedXpertQA Text modality (offline) | 38 | Jun 9, 2026 |
|---|
| Clinical Question Answering | LiveClin Text modality (offline) | 38 | Jun 9, 2026 |
|---|
| Multi-Criteria Decision Making | Alternative set A A1-A10 | 38 | Jun 8, 2026 |
|---|