Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Prefill | 3 | 3 | Jun 5, 2026 | |
| Linear Concept Accessibility and Steering | 3 | 1 | Apr 20, 2026 | |
| Reasoning trace quality evaluation | 3 | 1 | Apr 16, 2026 | |
| Reasoning failure prediction | 3 | 1 | Apr 21, 2026 | |
| Tool-use Inference | 3 | 1 | Apr 16, 2026 | |
| Multi-Turn Function Calling | 3 | 4 | May 28, 2026 | |
| LLM Generation Efficiency | 3 | 1 | Feb 22, 2026 | |
| Fine-grained Knowledge Recall | 3 | 1 | Apr 15, 2026 | |
| Task Decomposition |
| 3 |
| 3 |
| Jun 24, 2026 |
| Multi-turn dialogue routing | 3 | 1 | Apr 15, 2026 |
|---|
| Rubric satisfaction evaluation | 3 | 1 | Feb 21, 2026 |
|---|
| Goal-relevance Evaluation | 3 | 1 | Apr 15, 2026 |
|---|
| Safety-Utility Trade-off Evaluation | 3 | 3 | Jun 5, 2026 |
|---|
| Skill Learning | 3 | 1 | Feb 27, 2026 |
|---|
| Social Deduction Game Gameplay | 3 | 2 | May 29, 2026 |
|---|
| LoRA Adapter Transfer | 3 | 1 | Apr 15, 2026 |
|---|
| Knowledge Injection | 3 | 2 | May 19, 2026 |
|---|
| Single-Turn Mathematical Reasoning | 3 | 1 | Feb 20, 2026 |
|---|
| Long-form factuality evaluation | 3 | 1 | Apr 15, 2026 |
|---|
| Memory Evaluation | 3 | 2 | Jun 2, 2026 |
|---|
| Multimodal Medical Reasoning | 3 | 4 | Jul 1, 2026 |
|---|
| Multi-turn Jailbreak | 3 | 2 | Jun 2, 2026 |
|---|
| Self-confidence estimation | 3 | 1 | Feb 20, 2026 |
|---|
| Open generation | 3 | 3 | May 11, 2026 |
|---|
| Multi-step Reasoning over Code Dependencies | 3 | 1 | Apr 14, 2026 |
|---|