Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Self-Healing Tool Routing | 7 | 1 | Mar 4, 2026 | |
| Examination | 7 | 4 | Mar 11, 2026 | |
| Advanced Mathematical Reasoning | 7 | 4 | Apr 8, 2026 | |
| Jailbreak Resistance | 7 | 3 | May 26, 2026 | |
| End-to-End Inference | 7 | 4 | Jun 4, 2026 | |
| Multi-turn Conversation Evaluation | 7 | 11 | May 27, 2026 | |
| Long-context language modeling evaluation | 7 | 11 | Jun 1, 2026 | |
| User Satisfaction Evaluation | 7 | 2 | Jul 3, 2026 | |
| Multi-turn ambiguous query clarification |
| 7 |
| 1 |
| Feb 19, 2026 |
| Multi-attribute steering | 7 | 2 | Jun 23, 2026 |
|---|
| Teaming Perception Scale (TPS) Construct Validity Analysis | 7 | 1 | Apr 28, 2026 |
|---|
| Decode Throughput | 7 | 2 | Jul 2, 2026 |
|---|
| General Reasoning and Coding | 7 | 5 | Jun 29, 2026 |
|---|
| Comparison-QA | 7 | 1 | Apr 8, 2026 |
|---|
| LLM Steering | 7 | 2 | May 29, 2026 |
|---|
| General Reasoning & Understanding | 7 | 3 | May 14, 2026 |
|---|
| Comparison | 7 | 3 | Jun 2, 2026 |
|---|
| KV cache compression | 7 | 1 | Mar 31, 2026 |
|---|
| Time-controlled instruction-following | 7 | 1 | Mar 24, 2026 |
|---|
| Reasoning Question Answering | 7 | 8 | Jun 11, 2026 |
|---|
| Language Modeling Inference | 7 | 1 | Mar 24, 2026 |
|---|
| Prefill Latency | 7 | 2 | May 28, 2026 |
|---|
| Multi-Agent Reasoning | 7 | 3 | May 20, 2026 |
|---|
| Mathematical Question Answering | 7 | 7 | Jun 16, 2026 |
|---|
| Safety Refusal Evaluation | 7 | 2 | Jun 2, 2026 |
|---|