Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Activation Steering | 15 | 7 | May 21, 2026 | |
| Human preference prediction | 15 | 14 | May 26, 2026 | |
| General Knowledge Evaluation | 15 | 28 | Jun 25, 2026 | |
| Arithmetic Addition | 15 | 4 | Jun 18, 2026 | |
| LLM Serving | 15 | 8 | Jun 30, 2026 | |
| Helpfulness evaluation | 15 | 13 | Jul 7, 2026 | |
| Short-form generation | 14 | 2 | Jun 4, 2026 | |
| Multimodal Reward Modeling | 14 | 10 | May 12, 2026 | |
| Cultural Alignment | 14 | 6 | Jun 18, 2026 |
| Response Classification | 14 | 7 | Jun 1, 2026 |
|---|
| Long-context Memory Evaluation | 14 | 18 | Jul 2, 2026 |
|---|
| Continual Instruction Tuning | 14 | 9 | Jul 3, 2026 |
|---|
| Graph Classification Explanation | 14 | 2 | Jun 23, 2026 |
|---|
| Controllability | 14 | 3 | Apr 7, 2026 |
|---|
| General Capability | 14 | 16 | Jul 3, 2026 |
|---|
| Chat | 14 | 20 | Jul 9, 2026 |
|---|
| Long-form QA | 14 | 4 | Feb 19, 2026 |
|---|
| Safety and Utility Evaluation | 14 | 8 | Jun 4, 2026 |
|---|
| Factual Question Answering | 14 | 12 | Jun 17, 2026 |
|---|
| Faithfulness Detection | 14 | 5 | Jun 25, 2026 |
|---|
| Domain Reasoning | 14 | 3 | Jul 7, 2026 |
|---|
| Idea Generation | 14 | 7 | Jul 7, 2026 |
|---|
| Long Context | 14 | 9 | Jul 7, 2026 |
|---|
| Zero-shot Question Answering | 13 | 12 | Jun 15, 2026 |
|---|
| Downstream Task Evaluation | 13 | 14 | Jul 7, 2026 |
|---|