Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Language Modeling | Qwen3 (val) | 49 | May 14, 2026 | ||
| Audio-to-Text Retrieval | Clotho | 49 | May 27, 2026 | ||
| Audio Modeling | Blues 30s v1 (test) | 49 | Feb 26, 2026 | ||
| Audio Modeling | Counting 7s v1 (test) | 49 | Feb 26, 2026 | ||
| Dynamics Modeling | Barrett WAM (train) |
| 49 |
| Feb 26, 2026 |
| Large Language Model Evaluation | HuggingFace Open LLM Leaderboard | 49 | Mar 24, 2026 |
|---|
| Logic Reasoning | ZebraLogic | 49 | Jun 9, 2026 |
|---|
| Outlier Detection | Yeast | 49 | Mar 31, 2026 |
|---|
| Graph Anomaly Detection | Flickr | 49 | May 26, 2026 |
|---|
| Air Quality Forecasting | KnowAir | 49 | May 19, 2026 |
|---|
| Common Sense Reasoning | HellaSwag 0-shot | 49 | Jun 26, 2026 |
|---|
| Mathematical Reasoning | Math Reasoning Suite Average | 49 | May 27, 2026 |
|---|
| Pedestrian Intention Prediction | JAAD (All) | 49 | Apr 28, 2026 |
|---|
| Video Generation | VBench 2.0 (test) | 49 | May 11, 2026 |
|---|
| Text-to-Image Generation | T2I-ReasonBench | 49 | May 19, 2026 |
|---|
| Pulse Rate Estimation | UBFC-rPPG Intra-dataset | 49 | Jun 11, 2026 |
|---|
| Audio Visual Question Answering | AVQA (test) | 49 | Jun 8, 2026 |
|---|
| Video Understanding | MLVU 3-120min (test) | 49 | Feb 26, 2026 |
|---|
| Video Understanding | MLVU 3-120min (dev) | 49 | Feb 26, 2026 |
|---|
| Video Understanding | LongVideoBench 1-60min | 49 | Feb 26, 2026 |
|---|
| AI-Generated Image Detection | AIGI-Now | 49 | Jun 16, 2026 |
|---|
| Video Super-Resolution | MVSR4x | 49 | May 22, 2026 |
|---|
| Membership Inference Attack | CIFAR-10 (test) | 49 | Jul 3, 2026 |
|---|
| Instruction Following | AlpacaEval LC 2 | 49 | May 18, 2026 |
|---|
| Science | GPQA | 49 | Jun 15, 2026 |
|---|