Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Peer-Grading | 1 | 1 | Feb 18, 2026 | |
| Conversation Response Generation | 1 | 1 | Feb 18, 2026 | |
| Factuality Generation | 1 | 1 | Feb 18, 2026 | |
| Recommendation Explanation | 1 | 1 | Feb 20, 2026 | |
| Tool Summarization | 1 | 1 | Apr 15, 2026 | |
| General Mathematics Reasoning | 1 | 1 | Feb 20, 2026 | |
| Safety Classification and Filtering | 1 | 1 | Apr 15, 2026 | |
| Truthful and Informative Generation | 1 | 2 | Apr 23, 2026 | |
| Human-Model Agreement |
| 1 |
| 1 |
| Feb 20, 2026 |
| Multilingual Factual Reasoning | 1 | 1 | Apr 15, 2026 |
|---|
| Regulatory reasoning and claim validation | 1 | 1 | Feb 20, 2026 |
|---|
| Max token throughput | 1 | 1 | Feb 20, 2026 |
|---|
| Social Deduction Game Play | 1 | 1 | Apr 15, 2026 |
|---|
| Scientific Demonstration Generation | 1 | 1 | Apr 15, 2026 |
|---|
| Heads-Up Limit Hold'em Poker | 1 | 1 | Apr 15, 2026 |
|---|
| Language Model Alignment Evaluation | 1 | 1 | Feb 20, 2026 |
|---|
| Peer Review Feedback Generation | 1 | 1 | Apr 15, 2026 |
|---|
| Matching Human Consensus Feedback | 1 | 1 | Apr 15, 2026 |
|---|
| Knowledge Assessment and Commonsense Reasoning | 1 | 1 | Feb 20, 2026 |
|---|
| VLM Pairwise Preference | 1 | 1 | Apr 15, 2026 |
|---|
| Grade School Math Word Problem Solving | 1 | 3 | Mar 4, 2026 |
|---|
| Contextual Knowledge Adaptation (Prior-Conflicting) | 1 | 1 | Feb 20, 2026 |
|---|
| Slide Deck Generation Quality Evaluation | 1 | 1 | Apr 15, 2026 |
|---|
| LLM Safety | 1 | 1 | Feb 20, 2026 |
|---|
| Tool-use Execution | 1 | 1 | Apr 15, 2026 |
|---|