Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Copy | 2 | 1 | Mar 4, 2026 | |
| Human-AI Agreement Assessment | 2 | 1 | Mar 26, 2026 | |
| grade-school math | 2 | 3 | Jun 30, 2026 | |
| Islamic inheritance reasoning | 2 | 2 | Apr 21, 2026 | |
| Reasoning explanation generation | 2 | 2 | Mar 4, 2026 | |
| Standard Operating Procedure execution | 2 | 1 | Mar 25, 2026 | |
| General AI Assistant Task Execution | 2 | 1 | Mar 25, 2026 | |
| Instructed Code Generation | 2 | 1 | Mar 25, 2026 | |
| Belief Prediction |
| 2 |
| 2 |
| May 22, 2026 |
| Evidence-grounded diagnostic reasoning | 2 | 1 | Mar 25, 2026 |
|---|
| Uncovering hidden system prompts | 2 | 1 | Mar 25, 2026 |
|---|
| Multi-agent Negotiation | 2 | 2 | Apr 23, 2026 |
|---|
| SAE latent interpretation | 2 | 1 | Feb 18, 2026 |
|---|
| Visual Search and Reasoning | 2 | 2 | May 27, 2026 |
|---|
| LLM Inference Latency | 2 | 2 | May 8, 2026 |
|---|
| Zero-shot Language Modeling and Reasoning | 2 | 2 | Mar 27, 2026 |
|---|
| Multiple-choice commonsense reasoning | 2 | 2 | Apr 14, 2026 |
|---|
| Evaluation Reliability | 2 | 1 | Mar 24, 2026 |
|---|
| Response Moderation | 2 | 2 | Apr 7, 2026 |
|---|
| Complex Multi-step Reasoning | 2 | 3 | May 26, 2026 |
|---|
| Mathematical Calculation | 2 | 2 | Apr 10, 2026 |
|---|
| Arithmetic Planning | 2 | 2 | Jun 9, 2026 |
|---|
| Persona Simulation | 2 | 3 | Jun 15, 2026 |
|---|
| High-level instruction execution | 2 | 1 | Mar 24, 2026 |
|---|
| Reward Scoring | 2 | 2 | Apr 6, 2026 |
|---|