Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Visual Localization | 7Scenes Fire | 34 | Apr 27, 2026 | ||
| Visual Localization | 7Scenes Chess | 34 | Apr 27, 2026 | ||
| Visual Tracking | NFS | 34 | May 6, 2026 | ||
| Image-to-Text Retrieval | ShareGPT4V | 34 | May 26, 2026 | ||
| Temporal Video Grounding | ActivityNet TimeLens (test) | 34 | May 22, 2026 | ||
| Visual Quality Assessment |
|---|
| AIGCIQA 2023 |
| 34 |
| Feb 26, 2026 |
| Image Compression | DIV2K (test) | 34 | Jun 23, 2026 |
|---|
| Semantic Segmentation | SUIM | 34 | Apr 15, 2026 |
|---|
| Video Understanding | MLVU (test) | 34 | Feb 27, 2026 |
|---|
| Depth Estimation | SUN RGB-D | 34 | Mar 27, 2026 |
|---|
| Low-Light Video Enhancement | SDSD outdoor | 34 | Jun 11, 2026 |
|---|
| Low-Light Video Enhancement | SDSD indoor | 34 | Jun 11, 2026 |
|---|
| Text-to-Image Generation | Text-to-Image Generation | 34 | Feb 26, 2026 |
|---|
| Binary Classification | Income (test) | 34 | Mar 12, 2026 |
|---|
| Prohibited Content Detection | ALERT | 34 | Feb 26, 2026 |
|---|
| Physical Reasoning | PIQA | 34 | Feb 26, 2026 |
|---|
| Knowledge Base Question Answering | GrailQA (dev) | 34 | May 29, 2026 |
|---|
| Multiple Choice Non-STEM Question Answering | OlmoBaseEval MC Non-STEM (MMLU Humanities/Social Sci, CSQA, PiQA, SocialIQA, CoQA, DROP, Jeopardy, NaturalQs, SQuAD) | 34 | Apr 7, 2026 |
|---|
| Code Generation | OlmoBaseEval Code BigCodeBench, HumanEval, DeepSeek LeetCode, DS 1000, MBPP, MultiPL | 34 | Apr 7, 2026 |
|---|
| Mathematical Reasoning | OlmoBaseEval Math (GSM8k, GSM Symbolic, MATH) | 34 | Apr 7, 2026 |
|---|
| Dialogue Topic Segmentation | Doc2Dial | 34 | Jun 1, 2026 |
|---|
| Multiple-choice Question Answering | TruthfulQA Multiple-choice | 34 | Jun 4, 2026 |
|---|
| Reading Comprehension | Belebele 28 European languages | 34 | Apr 14, 2026 |
|---|
| Large Language Model Evaluation | Open LLM Leaderboard v1 (test) | 34 | May 12, 2026 |
|---|
| Chunking | Chunking | 34 | Feb 26, 2026 |
|---|