Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Aggregate Reasoning Evaluation | 2 | 2 | May 26, 2026 | |
| Knowledge-to-action question answering | 2 | 1 | Apr 10, 2026 | |
| Agreement with outcome human labels | 2 | 1 | Apr 9, 2026 | |
| Concept Forgetting | 2 | 1 | Apr 8, 2026 | |
| Motivational Interviewing Response Generation | 2 | 1 | Feb 18, 2026 | |
| Human forward simulatability | 2 | 1 | Feb 18, 2026 | |
| Out-of-scope refusal | 2 | 1 | Feb 19, 2026 | |
| Video generation reasoning | 2 | 2 | Jun 1, 2026 | |
| Citation Coverage Evaluation |
|---|
| 2 |
| 1 |
| Apr 8, 2026 |
| Progress Reasoning | 2 | 1 | Feb 19, 2026 |
|---|
| Safety-Utility Trade-off | 2 | 2 | Jun 1, 2026 |
|---|
| General Reasoning Average | 2 | 2 | Jun 2, 2026 |
|---|
| Conversational Assistant | 2 | 1 | Feb 18, 2026 |
|---|
| Agentic medical interaction | 2 | 1 | Apr 8, 2026 |
|---|
| Proof writing | 2 | 2 | Jun 26, 2026 |
|---|
| Bilingual Mathematical Reasoning | 2 | 1 | Feb 18, 2026 |
|---|
| Generalization to Unseen Preferences | 2 | 1 | Apr 7, 2026 |
|---|
| Reward-wise QA fairness and alignment | 2 | 1 | Apr 7, 2026 |
|---|
| Reasoning Generation | 2 | 2 | Apr 27, 2026 |
|---|
| Reference-free Conversation Evaluation | 2 | 1 | Apr 7, 2026 |
|---|
| Expert Preference Pairwise | 2 | 1 | Apr 7, 2026 |
|---|
| Tool Use Accuracy | 2 | 1 | Feb 18, 2026 |
|---|
| Chit-chat conversation evaluation correlation | 2 | 1 | Apr 7, 2026 |
|---|
| Scientific Verification | 2 | 1 | Apr 8, 2026 |
|---|
| Reward Model Controllability | 2 | 1 | Apr 7, 2026 |
|---|