Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| multi-branch story generation | 3 | 1 | Apr 21, 2026 | |
| Preference Labeling | 3 | 1 | Apr 21, 2026 | |
| AlpacaEval 2.0 | 3 | 1 | Feb 22, 2026 | |
| Long-form Question Answering refinement | 3 | 1 | Feb 18, 2026 | |
| Multi-hop reasoning and question answering | 3 | 1 | Feb 22, 2026 | |
| Long-form generation factuality and uncertainty estimation | 3 | 1 | Feb 18, 2026 | |
| Sycophancy Assessment | 3 | 1 | Apr 21, 2026 | |
| Reasoning trace quality evaluation | 3 | 1 | Apr 16, 2026 | |
| Bayesian Assessment of Sycophancy |
| 3 |
| 1 |
| Apr 21, 2026 |
| Linear Concept Accessibility and Steering | 3 | 1 | Apr 20, 2026 |
|---|
| Reasoning accuracy | 3 | 2 | Apr 8, 2026 |
|---|
| Output Equivalence | 3 | 1 | Feb 22, 2026 |
|---|
| Instruction-based Video Editing | 3 | 3 | Jun 30, 2026 |
|---|
| Tool-use Inference | 3 | 1 | Apr 16, 2026 |
|---|
| Open-ended Reasoning | 3 | 3 | May 22, 2026 |
|---|
| Policy Question Answering | 3 | 1 | Apr 15, 2026 |
|---|
| Multi-turn dialogue routing | 3 | 1 | Apr 15, 2026 |
|---|
| Binary Addition | 3 | 3 | Jun 30, 2026 |
|---|
| Fine-grained Knowledge Recall | 3 | 1 | Apr 15, 2026 |
|---|
| Instruction following and reasoning | 3 | 3 | Feb 27, 2026 |
|---|
| LLM Generation Efficiency | 3 | 1 | Feb 22, 2026 |
|---|
| Knowledge-grounded Dialog Generation | 3 | 2 | Feb 18, 2026 |
|---|
| Human Evaluation of Explanations | 3 | 2 | Jun 24, 2026 |
|---|
| Uncertainty-guided selective generation | 3 | 1 | Apr 21, 2026 |
|---|
| Response Length Prediction | 3 | 2 | Feb 19, 2026 |
|---|