Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Speech Instruction-Following | 6 | 3 | Jun 26, 2026 | |
| Honesty Alignment | 6 | 2 | May 19, 2026 | |
| General Instruction Following | 6 | 12 | Jul 7, 2026 | |
| Multi-task Language Evaluation | 6 | 7 | Jul 3, 2026 | |
| Multistep Reasoning | 6 | 10 | Jun 4, 2026 | |
| Persona Bias Evaluation | 6 | 1 | Apr 9, 2026 | |
| Controllability Robustness Prediction | 6 | 1 | Mar 4, 2026 | |
| Long-horizon agentic task | 6 | 2 | May 26, 2026 | |
| Generative Performance |
|---|
| 6 |
| 2 |
| May 13, 2026 |
| Model Alignment | 6 | 3 | Jul 1, 2026 |
|---|
| Quality Evaluation | 6 | 2 | Apr 14, 2026 |
|---|
| Robot Instruction Following | 6 | 2 | Jun 1, 2026 |
|---|
| Knowledge-Grounded Conversation | 6 | 2 | Feb 18, 2026 |
|---|
| Question Answering with Abstention | 6 | 3 | May 12, 2026 |
|---|
| General Tasks | 6 | 6 | May 20, 2026 |
|---|
| Episodic Memory Retrieval | 6 | 1 | Feb 22, 2026 |
|---|
| Countdown | 6 | 3 | Jun 17, 2026 |
|---|
| Multi-turn Dialogue Generation | 6 | 4 | Jul 1, 2026 |
|---|
| Deep Research Evaluation | 6 | 2 | May 27, 2026 |
|---|
| Refusal Detection | 6 | 4 | May 12, 2026 |
|---|
| Creativity Evaluation | 6 | 2 | May 19, 2026 |
|---|
| Long-horizon agentic tasks | 6 | 1 | Mar 31, 2026 |
|---|
| Multi-turn Visual Question Answering | 6 | 1 | Mar 24, 2026 |
|---|
| Episodic Memory Recall | 6 | 1 | Feb 22, 2026 |
|---|
| Critique Quality Evaluation | 6 | 1 | Feb 18, 2026 |
|---|