Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Molecular Science Instructions | 2 | 1 | Feb 18, 2026 | |
| Open-book generation under knowledge conflict | 2 | 1 | Feb 19, 2026 | |
| Consultation Capability Evaluation | 2 | 1 | Apr 13, 2026 | |
| Language Conditioned Transfer | 2 | 1 | Apr 10, 2026 | |
| Dialogue commonsense evaluation | 2 | 1 | Feb 18, 2026 | |
| LLM Serving Efficiency | 2 | 1 | Apr 10, 2026 | |
| Multi-agent contract design | 2 | 1 | Apr 10, 2026 | |
| Single-agent contract design | 2 | 1 |
| Apr 10, 2026 |
| Steering Validation | 2 | 1 | Apr 10, 2026 |
|---|
| College-level Problems | 2 | 1 | Feb 18, 2026 |
|---|
| Memory Recall Efficiency | 2 | 1 | Feb 19, 2026 |
|---|
| Enterprise interface interaction | 2 | 1 | Apr 10, 2026 |
|---|
| Game of 24 | 2 | 2 | Feb 27, 2026 |
|---|
| General Writing | 2 | 1 | Feb 19, 2026 |
|---|
| Enterprise interface task completion | 2 | 1 | Apr 10, 2026 |
|---|
| Multi-modal preference alignment | 2 | 1 | Feb 18, 2026 |
|---|
| Knowledge-to-action question answering | 2 | 1 | Apr 10, 2026 |
|---|
| Sales interaction performance | 2 | 1 | Apr 10, 2026 |
|---|
| Rule Following | 2 | 1 | Apr 13, 2026 |
|---|
| Memory Updating | 2 | 3 | Jun 25, 2026 |
|---|
| Relational Hallucination Evaluation | 2 | 1 | Apr 10, 2026 |
|---|
| Robot Failure Analysis (MCQ) | 2 | 1 | Apr 10, 2026 |
|---|
| Free-language reasoning | 2 | 1 | Apr 10, 2026 |
|---|
| Graduate-level Q&A | 2 | 2 | Apr 30, 2026 |
|---|
| Self-doubt detection | 2 | 1 | Apr 9, 2026 |
|---|