Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Complex reasoning and knowledge-based question-answering | 1 | 1 | Feb 19, 2026 | |
| Human-level Standardized Exam Evaluation | 1 | 3 | Apr 30, 2026 | |
| Conversation labeling | 1 | 1 | Mar 31, 2026 | |
| Turn-level correlation with human Overall Quality ratings | 1 | 1 | Feb 18, 2026 | |
| Prompt Expansion | 1 | 1 | Feb 18, 2026 | |
| Many-shot ICL Efficiency | 1 | 1 | Feb 18, 2026 | |
| self-affirmation | 1 | 1 | Feb 19, 2026 | |
| Numerical Anchoring Effect Evaluation | 1 | 1 | Mar 31, 2026 | |
| Anchoring Effect Evaluation |
| 1 |
| 1 |
| Mar 31, 2026 |
| Commonsense Reasoning and Knowledge | 1 | 1 | Mar 31, 2026 |
|---|
| Story Customization | 1 | 1 | Mar 31, 2026 |
|---|
| Interactive Document Generation | 1 | 1 | Mar 31, 2026 |
|---|
| EM Decision-Making (AJSD) | 1 | 1 | Mar 31, 2026 |
|---|
| AI Agent Reasoning and Tool-use | 1 | 3 | Jul 1, 2026 |
|---|
| Turn-level dialogue quality evaluation (Understandable) | 1 | 1 | Feb 18, 2026 |
|---|
| Language Modeling and Zero-shot Reasoning | 1 | 1 | Feb 19, 2026 |
|---|
| Clinical Diagnosis and Reasoning | 1 | 1 | Mar 31, 2026 |
|---|
| Character Consistency | 1 | 2 | Mar 4, 2026 |
|---|
| Repetition | 1 | 1 | Feb 19, 2026 |
|---|
| Understanding-Generation Consistency | 1 | 1 | Mar 31, 2026 |
|---|
| Multimodal Consistency | 1 | 1 | Mar 31, 2026 |
|---|
| Complex Reasoning and Instruction Following | 1 | 1 | Feb 19, 2026 |
|---|
| Language-based Planning | 1 | 1 | Mar 31, 2026 |
|---|
| Scientific Agent Task Completion | 1 | 2 | Apr 28, 2026 |
|---|
| Role-playing Attractiveness | 1 | 1 | Feb 18, 2026 |
|---|