Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| False Refusal Evaluation | 4 | 2 | Mar 17, 2026 | |
| Reasoning-Aware Threat Detection | 4 | 1 | Mar 4, 2026 | |
| Large Multi-modal Model Evaluation | 4 | 4 | Apr 8, 2026 | |
| Logical Retrieval | 4 | 2 | Apr 14, 2026 | |
| Fair Generation | 4 | 1 | Feb 18, 2026 | |
| Chain-of-reasoning | 4 | 1 | Feb 19, 2026 | |
| Personality Alignment | 4 | 2 | May 1, 2026 | |
| Transitive reasoning | 4 | 1 | Apr 15, 2026 | |
| Conversational Ability |
| 4 |
| 6 |
| Mar 24, 2026 |
| Memory Extraction | 4 | 5 | Jun 25, 2026 |
|---|
| Compositional Steering | 4 | 1 | Feb 19, 2026 |
|---|
| Explanation self-consistency | 4 | 1 | Apr 14, 2026 |
|---|
| Judge Agreement | 4 | 1 | Feb 18, 2026 |
|---|
| Therapeutic Game Evaluation | 4 | 1 | Apr 14, 2026 |
|---|
| Pairwise Evaluation | 4 | 2 | Jun 1, 2026 |
|---|
| Long-Horizon Stability | 4 | 2 | May 14, 2026 |
|---|
| Function Vector Evaluation | 4 | 1 | Feb 27, 2026 |
|---|
| Disruption | 4 | 1 | Apr 10, 2026 |
|---|
| CoT Soundness Evaluation | 4 | 1 | Apr 10, 2026 |
|---|
| CoT Naturalness | 4 | 1 | Apr 10, 2026 |
|---|
| Emotional Support | 4 | 1 | Mar 4, 2026 |
|---|
| Utility assessment | 4 | 4 | Apr 20, 2026 |
|---|
| Multi-party Dialogue Generation | 4 | 1 | Apr 10, 2026 |
|---|
| Multi-modal Chat | 4 | 1 | Feb 18, 2026 |
|---|
| Long-form text generation | 4 | 6 | Jul 9, 2026 |
|---|