Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Action Recognition | Kinetics | 83 | Mar 30, 2026 | ||
| Video Panoptic Segmentation | VIPSeg (val) | 83 | Mar 27, 2026 | ||
| Retrieval | TREC DL 2019 | 83 | May 11, 2026 | ||
| Question Answering | SQuAD | 83 | Mar 27, 2026 | ||
| Image Generation | ImageNet 64x64 (train val) |
| 83 |
| Feb 26, 2026 |
| Truthful QA | Truthful QA | 83 | Feb 26, 2026 |
|---|
| Jailbreak Attack | MalwareBench | 82 | Jun 11, 2026 |
|---|
| Jailbreak Attack | RMCBench | 82 | Jun 11, 2026 |
|---|
| Zero-shot Evaluation | Zero-shot Evaluation Suite (ARC-c, ARC-e, HellaSwag, PIQA, WinoGrande) | 82 | Jun 4, 2026 |
|---|
| Grounding | ScreenSpot Pro | 82 | Jun 23, 2026 |
|---|
| Mathematical Reasoning | GSM8K Hard | 82 | Jun 5, 2026 |
|---|
| Audio Reasoning | MMAR | 82 | Jun 16, 2026 |
|---|
| Math reasoning | JEEBench | 82 | Mar 10, 2026 |
|---|
| Mathematical Reasoning | MATH500 | 82 | Mar 10, 2026 |
|---|
| Mathematical Reasoning | GSM8K 5-shot | 82 | Jun 23, 2026 |
|---|
| Long-context understanding | LongBench | 82 | Apr 15, 2026 |
|---|
| Graph Explanation | ACM | 82 | Jun 4, 2026 |
|---|
| Few-Shot Segmentation | Chest X-Ray | 82 | Mar 23, 2026 |
|---|
| Jailbreaking Attack | MM-SafetyBench | 82 | Jul 7, 2026 |
|---|
| Code Generation | HumanE | 82 | May 12, 2026 |
|---|
| Reward Modeling | RewardBench Focus 2 | 82 | Feb 26, 2026 |
|---|
| Instruction Following | ALFWorld | 82 | Feb 26, 2026 |
|---|
| Video Generation | VBench (test) | 82 | Jul 7, 2026 |
|---|
| Image Classification | 8 Vision Tasks (test) | 82 | Apr 3, 2026 |
|---|
| Image-level Anomaly Detection | MVTec AD | 82 | Apr 10, 2026 |
|---|