Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Chat & Instruction Following | 4 | 2 | Jul 7, 2026 | |
| Multilingual Reasoning and Language Understanding | 4 | 1 | Apr 15, 2026 | |
| Function Vector Evaluation | 4 | 1 | Feb 27, 2026 | |
| Transitive reasoning | 4 | 1 | Apr 15, 2026 | |
| LLM-as-judge head-to-head comparison | 4 | 1 | Mar 4, 2026 | |
| Unsupervised Error Diagnosis | 4 | 1 | Apr 21, 2026 | |
| Tool-use behavioral profiling | 4 | 1 | Apr 15, 2026 | |
| Process Reward Modeling | 4 | 6 | Jul 1, 2026 | |
| Feedback Evaluation Alignment |
| 4 |
| 1 |
| Feb 18, 2026 |
| Utility assessment | 4 | 4 | Apr 20, 2026 |
|---|
| Knowledge-based Dialogue | 4 | 1 | Feb 18, 2026 |
|---|
| Deductive logical reasoning | 4 | 1 | Feb 27, 2026 |
|---|
| Long-Horizon Stability | 4 | 2 | May 14, 2026 |
|---|
| Output Diversity | 4 | 4 | Jun 1, 2026 |
|---|
| Multi-turn audio dialogue | 4 | 1 | Feb 18, 2026 |
|---|
| Explanation self-consistency | 4 | 1 | Apr 14, 2026 |
|---|
| Consistency Evaluation | 4 | 3 | May 19, 2026 |
|---|
| Pairwise Evaluation | 4 | 2 | Jun 1, 2026 |
|---|
| Disruption | 4 | 1 | Apr 10, 2026 |
|---|
| CoT Length Prediction | 4 | 1 | Mar 12, 2026 |
|---|
| Proactive Dialogue Generation | 4 | 1 | May 13, 2026 |
|---|
| Zero-shot downstream evaluation | 4 | 4 | May 21, 2026 |
|---|
| Insight Discovery and Guidance | 4 | 1 | Apr 21, 2026 |
|---|
| Therapeutic Game Evaluation | 4 | 1 | Apr 14, 2026 |
|---|
| Pairwise Preference Comparison | 4 | 3 | May 29, 2026 |
|---|