Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Generalization Assessment | 1 | 1 | May 26, 2026 | |
| Standard Mathematics | 1 | 1 | Mar 30, 2026 | |
| Medical Knowledge Performance | 1 | 1 | Feb 19, 2026 | |
| Visual Chat | 1 | 1 | May 26, 2026 | |
| Domain Capability Evaluation | 1 | 1 | Jun 29, 2026 | |
| Chat-based Image Retrieval | 1 | 1 | Feb 18, 2026 | |
| Long-range memory evaluation | 1 | 1 | Jun 29, 2026 | |
| Behavioral Dialogue Evaluation | 1 | 1 | Mar 13, 2026 | |
| secret-word task |
| 1 |
| 1 |
| May 26, 2026 |
| Instruction-driven Navigation | 1 | 1 | May 27, 2026 |
|---|
| Real-Life Creative Problem Solving | 1 | 1 | Jun 29, 2026 |
|---|
| general multi-choice | 1 | 1 | Mar 31, 2026 |
|---|
| Multilingual Long-context Classification | 1 | 1 | Feb 19, 2026 |
|---|
| Interdisciplinary Research Ideation | 1 | 1 | Mar 13, 2026 |
|---|
| Reasoning Step Judgment | 1 | 1 | May 27, 2026 |
|---|
| Interdisciplinary Scientific Ideation | 1 | 1 | Mar 13, 2026 |
|---|
| Multi-turn Coding | 1 | 1 | May 27, 2026 |
|---|
| Empathy evaluation | 1 | 1 | Feb 18, 2026 |
|---|
| Generation Quality and Coherence Evaluation | 1 | 1 | Feb 19, 2026 |
|---|
| Multi-turn Collaboration Editing | 1 | 1 | May 27, 2026 |
|---|
| Mobile Application Operation | 1 | 1 | Mar 16, 2026 |
|---|
| Multi-turn Collaboration Reasoning | 1 | 1 | May 27, 2026 |
|---|
| LLM Risk Assessment | 1 | 1 | Feb 19, 2026 |
|---|
| Dangerous Knowledge Unlearning | 1 | 1 | May 27, 2026 |
|---|
| Human preference alignment for text-to-image generation | 1 | 1 | May 27, 2026 |
|---|