Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Interactive Query Answering (Average MRR) | 1 | 1 | Mar 27, 2026 | |
| Environment Alignment | 1 | 1 | Mar 13, 2026 | |
| Overall Generation Quality | 1 | 1 | May 26, 2026 | |
| Contextual Understanding and Reasoning | 1 | 1 | Feb 19, 2026 | |
| MM Alignment | 1 | 1 | Jun 25, 2026 | |
| Topic Classification and Text Generation | 1 | 1 | Feb 18, 2026 | |
| Knowledge and Commonsense Reasoning | 1 | 3 | Feb 19, 2026 | |
| Medical History Taking and Differential Diagnosis | 1 | 1 | Feb 19, 2026 |
| Personalized Assistant Interaction | 1 | 1 | Mar 13, 2026 |
|---|
| Generalization Assessment | 1 | 1 | May 26, 2026 |
|---|
| Video Streaming Conversation | 1 | 1 | Mar 27, 2026 |
|---|
| Lyrics Creation | 1 | 1 | Feb 19, 2026 |
|---|
| Conversational agents in customer-service environments | 1 | 1 | Jun 25, 2026 |
|---|
| Visual Chat | 1 | 1 | May 26, 2026 |
|---|
| Behavioral Dialogue Evaluation | 1 | 1 | Mar 13, 2026 |
|---|
| secret-word task | 1 | 1 | May 26, 2026 |
|---|
| Instruction-driven Navigation | 1 | 1 | May 27, 2026 |
|---|
| Multilingual Long-context Classification | 1 | 1 | Feb 19, 2026 |
|---|
| Interdisciplinary Research Ideation | 1 | 1 | Mar 13, 2026 |
|---|
| Reasoning Step Judgment | 1 | 1 | May 27, 2026 |
|---|
| Interdisciplinary Scientific Ideation | 1 | 1 | Mar 13, 2026 |
|---|
| Multi-turn Coding | 1 | 1 | May 27, 2026 |
|---|
| Empathy evaluation | 1 | 1 | Feb 18, 2026 |
|---|
| Generation Quality and Coherence Evaluation | 1 | 1 | Feb 19, 2026 |
|---|
| Multi-turn Collaboration Editing | 1 | 1 | May 27, 2026 |
|---|