Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Single-hop Tool Calling | 1 | 1 | May 12, 2026 | |
| Mathematical and Science Reasoning | 1 | 1 | Mar 4, 2026 | |
| Multi-hop tool-use evaluation | 1 | 1 | May 12, 2026 | |
| Empathetic Experience Evaluation | 1 | 1 | Feb 18, 2026 | |
| Health-related dialogue and decision-making | 1 | 2 | May 19, 2026 | |
| Long-context Management | 1 | 1 | May 12, 2026 | |
| STEM Theorem Question Answering | 1 | 1 | May 12, 2026 | |
| Story Reasoning | 1 | 5 | May 14, 2026 | |
| 1 |
| 1 |
| May 12, 2026 |
| General Capability Estimation | 1 | 1 | Feb 18, 2026 |
|---|
| LLM Query Routing | 1 | 1 | Mar 4, 2026 |
|---|
| Multimodal Role-playing | 1 | 1 | May 12, 2026 |
|---|
| Permission-aware generation | 1 | 1 | May 12, 2026 |
|---|
| Decode Latency | 1 | 1 | May 12, 2026 |
|---|
| Long-horizon robotic instruction following | 1 | 1 | May 12, 2026 |
|---|
| Chime-in Reason | 1 | 1 | Mar 4, 2026 |
|---|
| Structural curriculum understanding | 1 | 1 | May 12, 2026 |
|---|
| Multi-turn visual dialogue | 1 | 1 | May 12, 2026 |
|---|
| General Reasoning and Language Understanding | 1 | 1 | Mar 4, 2026 |
|---|
| Topical Text Steering | 1 | 1 | May 12, 2026 |
|---|
| Sampling Diversity Analysis | 1 | 1 | Mar 4, 2026 |
|---|
| LLM serving optimization | 1 | 1 | May 12, 2026 |
|---|
| Assistant Response Generation | 1 | 1 | May 12, 2026 |
|---|
| Dialog Creation | 1 | 1 | May 12, 2026 |
|---|
| Multimodal Instruction Tuning | 1 | 1 | Mar 4, 2026 |
|---|