Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Hallucination Detection | HaluEval, HotpotQA, TriviaQA, SQuAD | 36 | Jun 30, 2026 | ||
| Vulnerable code generation | Vulnerable code generation scenario | 36 | Jun 30, 2026 | ||
| Aerodynamic Coefficient Prediction | AIAA UQ Challenge 2 (withheld val points) | 36 | Jun 30, 2026 | ||
| Long-context Reasoning | LongReason Average across 16k-64k | 36 | Jun 26, 2026 | ||
| Long-context Reasoning | LongReason 64k prefill length |
| 36 |
| Jun 26, 2026 |
| Long-context Reasoning | LongReason 32k prefill length | 36 | Jun 26, 2026 |
|---|
| Long-context Reasoning | LongReason 16k prefill length 1.0 (test) | 36 | Jun 26, 2026 |
|---|
| Slice Super-Resolution | Colon | 36 | Jun 26, 2026 |
|---|
| RAG Poisoning Attack | TriviaQA | 36 | Jun 26, 2026 |
|---|
| RAG Poisoning Attack | Natural Questions | 36 | Jun 26, 2026 |
|---|
| RAG Poisoning Attack | MS MARCO | 36 | Jun 26, 2026 |
|---|
| Few-shot classification | Laser welding molten pool image dataset (test) | 36 | Jun 25, 2026 |
|---|
| Spatiotemporal Forecasting | E-PEMS-BAY (test) | 36 | Jun 25, 2026 |
|---|
| Spatiotemporal Forecasting | Wabash River (test) | 36 | Jun 25, 2026 |
|---|
| Feature Matching | HPatches | 36 | Jun 24, 2026 |
|---|
| Code Generation | MBPP 3-shot | 36 | Jun 23, 2026 |
|---|
| Workflow Orchestration | Video | 36 | Jun 23, 2026 |
|---|
| Workflow Orchestration | Audio | 36 | Jun 23, 2026 |
|---|
| Uncertainty Quantification (Scalar Regression) | Setting 4 Generative Example | 36 | Jun 23, 2026 |
|---|
| Uncertainty Quantification (Scalar Regression) | Setting 3 Generative Example | 36 | Jun 23, 2026 |
|---|
| Uncertainty Quantification (Scalar Regression) | Setting Generative Example 2 | 36 | Jun 23, 2026 |
|---|
| Uncertainty Quantification (Scalar Regression) | Setting 1 Generative Example | 36 | Jun 23, 2026 |
|---|
| Regression | SYN3 | 36 | Jun 23, 2026 |
|---|
| Regression | SYN2 | 36 | Jun 23, 2026 |
|---|
| Regression | SYN1 | 36 | Jun 23, 2026 |
|---|