Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Membership Inference Attack | IMDB | 32 | Apr 24, 2026 | ||
| Membership Inference Attack | SST | 32 | Apr 24, 2026 | ||
| Membership Inference Attack | Yelp | 32 | Apr 24, 2026 | ||
| Membership Inference Attack | CoLA | 32 | Apr 24, 2026 | ||
| Scientific Reasoning | ARCc | 32 | Apr 23, 2026 | ||
| Reading Comprehension | Belebele c |
| 32 |
| Apr 23, 2026 |
| Talking Head Generation | MEAD | 32 | Apr 23, 2026 |
|---|
| Visual Reasoning | MMMU-Pro | 32 | Apr 23, 2026 |
|---|
| Visual Reasoning | VizWiz | 32 | Apr 23, 2026 |
|---|
| Visual Reasoning | A-OKVQA | 32 | Apr 23, 2026 |
|---|
| Multi-modal Alignment and Classification | ImageBind Target label (test) | 32 | Apr 23, 2026 |
|---|
| Multi-modal Alignment and Classification | ImageBind Original label (test) | 32 | Apr 23, 2026 |
|---|
| Toxicity Mitigation | Toxicity prompts | 32 | Apr 23, 2026 |
|---|
| Hyperspectral Image Classification | Qingyun (test) | 32 | Jun 2, 2026 |
|---|
| Object Detection Reliability Estimation | Foggy Cityscapes OOD | 32 | Apr 23, 2026 |
|---|
| Object Detection Reliability Estimation | Cityscapes near OOD | 32 | Apr 23, 2026 |
|---|
| Object Detection Reliability Estimation | COCO in-distribution | 32 | Apr 23, 2026 |
|---|
| STL Motion Planning | Custom-built 2D environment (test) | 32 | Apr 21, 2026 |
|---|
| Function Calling | BFCL V4 | 32 | Jun 8, 2026 |
|---|
| VLM-as-a-Judge | MLLM-as-a-Judge | 32 | Apr 21, 2026 |
|---|
| Medical Image Classification | RetinaMNIST | 32 | May 27, 2026 |
|---|
| Mathematical Reasoning | GSM8k | 32 | Apr 21, 2026 |
|---|
| Source Code Watermarking | MBJP | 32 | Apr 21, 2026 |
|---|
| Source Code Watermarking | MBCPP | 32 | Apr 21, 2026 |
|---|
| Multi-modal Understanding | MME | 32 | Jun 24, 2026 |
|---|