Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Medical Instruction Following | 3 | 1 | Feb 22, 2026 | |
| Multi-Choice | 3 | 3 | May 26, 2026 | |
| Instruction Following and Safety Evaluation | 3 | 3 | May 8, 2026 | |
| Open-domain Conversation | 3 | 2 | Feb 19, 2026 | |
| Multistep Soft Reasoning | 3 | 5 | Jun 30, 2026 | |
| Follow-up Questioning Consistency | 3 | 1 | Feb 18, 2026 | |
| Meeting Planning | 3 | 3 | Jun 4, 2026 | |
| Attention Operator Throughput | 3 | 2 | May 7, 2026 | |
| Sycophancy Assessment |
| 3 |
| 1 |
| Apr 21, 2026 |
| Content Generation (Micro Alignment) | 3 | 1 | Feb 18, 2026 |
|---|
| Instruction Execution | 3 | 1 | Feb 18, 2026 |
|---|
| High-Level Reasoning | 3 | 3 | Jul 1, 2026 |
|---|
| Bayesian Assessment of Sycophancy | 3 | 1 | Apr 21, 2026 |
|---|
| Reasoning trace quality evaluation | 3 | 1 | Apr 16, 2026 |
|---|
| Behavior Prediction (Micro Alignment) | 3 | 1 | Feb 18, 2026 |
|---|
| Linear Concept Accessibility and Steering | 3 | 1 | Apr 20, 2026 |
|---|
| Reliability of post-edit LLMs | 3 | 1 | Feb 27, 2026 |
|---|
| Policy Question Answering | 3 | 1 | Apr 15, 2026 |
|---|
| Goal-relevance Evaluation | 3 | 1 | Apr 15, 2026 |
|---|
| Black-box system prompt extraction | 3 | 1 | Feb 18, 2026 |
|---|
| Prefill | 3 | 3 | Jun 5, 2026 |
|---|
| ECG dialogue response quality evaluation | 3 | 1 | Feb 18, 2026 |
|---|
| Instruction-based Video Editing | 3 | 3 | Jun 30, 2026 |
|---|
| Tool-use Inference | 3 | 1 | Apr 16, 2026 |
|---|
| Task Decomposition | 3 | 3 | Jun 24, 2026 |
|---|