Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Multi-turn interaction trajectory evaluation | 1 | 1 | Mar 27, 2026 | |
| Role-play dialogue comprehension | 1 | 1 | May 26, 2026 | |
| Polish Instruction Following | 1 | 1 | Mar 13, 2026 | |
| Multi-discipline Knowledge Evaluation | 1 | 1 | May 26, 2026 | |
| Mathematical reasoning and formula selection | 1 | 1 | Jun 23, 2026 | |
| LLM Agent Memory Retrieval | 1 | 1 | Feb 19, 2026 | |
| Digit Span | 1 | 1 | May 26, 2026 | |
| Aggregate Cognitive Performance | 1 | 1 | May 26, 2026 | |
| Harmful question-answering |
| 1 |
| 1 |
| Feb 18, 2026 |
| Memory Construction Quality | 1 | 1 | May 26, 2026 |
|---|
| Trait-wise Automated Essay Scoring | 1 | 1 | May 26, 2026 |
|---|
| LLM Agent Optimization | 1 | 1 | Jun 23, 2026 |
|---|
| Multi-discipline Visual Reasoning | 1 | 1 | Mar 27, 2026 |
|---|
| Language Model Performance Evaluation | 1 | 1 | May 26, 2026 |
|---|
| Watermarked Text Generation | 1 | 1 | May 26, 2026 |
|---|
| Environment Alignment | 1 | 1 | Mar 13, 2026 |
|---|
| Overall Generation Quality | 1 | 1 | May 26, 2026 |
|---|
| Topic Classification and Text Generation | 1 | 1 | Feb 18, 2026 |
|---|
| Knowledge and Commonsense Reasoning | 1 | 3 | Feb 19, 2026 |
|---|
| Medical History Taking and Differential Diagnosis | 1 | 1 | Feb 19, 2026 |
|---|
| Personalized Assistant Interaction | 1 | 1 | Mar 13, 2026 |
|---|
| Generalization Assessment | 1 | 1 | May 26, 2026 |
|---|
| Visual Chat | 1 | 1 | May 26, 2026 |
|---|
| Behavioral Dialogue Evaluation | 1 | 1 | Mar 13, 2026 |
|---|
| secret-word task | 1 | 1 | May 26, 2026 |
|---|