Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Diversity | 10 | 2 | May 1, 2026 | |
| Harmful Request Compliance | 10 | 1 | Feb 18, 2026 | |
| Knowledge Conflict Resolution | 10 | 4 | Jun 25, 2026 | |
| Multimodal Preference Evaluation | 10 | 2 | Apr 2, 2026 | |
| Knowledge & Reasoning | 10 | 8 | May 13, 2026 | |
| Graduate-Level Reasoning | 10 | 18 | Jun 16, 2026 | |
| Personalized Response Generation | 10 | 5 | Jun 2, 2026 | |
| MCQ Classification | 10 | 1 | Feb 18, 2026 | |
| Skill Routing |
| 10 |
| 3 |
| Jun 12, 2026 |
| Multi-turn Dialogue Evaluation | 10 | 43 | Jun 23, 2026 |
|---|
| Reward Modeling Evaluation | 10 | 13 | Jun 9, 2026 |
|---|
| General Performance | 10 | 11 | Jun 26, 2026 |
|---|
| Rationale Generation | 10 | 6 | Feb 25, 2026 |
|---|
| Safety & Helpfulness Evaluation | 10 | 5 | Jun 4, 2026 |
|---|
| Steering | 10 | 4 | May 8, 2026 |
|---|
| Arithmetic | 10 | 8 | Jun 4, 2026 |
|---|
| Travel Planning | 10 | 12 | Jul 7, 2026 |
|---|
| Reasoning Quality Evaluation | 10 | 7 | Jun 29, 2026 |
|---|
| Prompt Recovery | 10 | 4 | May 26, 2026 |
|---|
| Long-form Answer Generation | 10 | 1 | Apr 14, 2026 |
|---|
| Controllable Language Generation | 10 | 2 | Feb 18, 2026 |
|---|
| Bargaining | 10 | 4 | Apr 21, 2026 |
|---|
| Autonomous LLM Fine-tuning | 10 | 1 | Apr 16, 2026 |
|---|
| Instruction-following clustering | 10 | 1 | Mar 26, 2026 |
|---|
| Clinical Reasoning | 10 | 7 | Jun 9, 2026 |
|---|