Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Pairwise Report Evaluation | 12 | 1 | Jun 8, 2026 | |
| Safety and Informativeness Evaluation | 12 | 1 | Jun 2, 2026 | |
| Generative Task | 12 | 4 | Jun 23, 2026 | |
| LLM-as-a-judge evaluation | 12 | 6 | Jun 19, 2026 | |
| Instruction Hierarchy Robustness | 12 | 1 | Mar 12, 2026 | |
| Time to First Token (TTFT) | 12 | 4 | Jun 19, 2026 | |
| Creative Generation | 12 | 6 | Jun 30, 2026 | |
| Needle-in-a-Haystack | 11 | 9 | May 7, 2026 | |
| Supervised Fine-tuning |
| 11 |
| 5 |
| Jul 3, 2026 |
| Helpfulness | 11 | 8 | Jul 7, 2026 |
|---|
| MLLM Unlearning | 11 | 2 | Jun 2, 2026 |
|---|
| Task Completion | 11 | 7 | Jul 9, 2026 |
|---|
| Preference Modeling | 11 | 8 | Jun 11, 2026 |
|---|
| Chain-of-Thought Reasoning | 11 | 8 | Jun 2, 2026 |
|---|
| Unseen prompt generalization | 11 | 1 | Feb 18, 2026 |
|---|
| Decoding | 11 | 6 | Jun 2, 2026 |
|---|
| Visual Instruction Tuning | 11 | 5 | May 25, 2026 |
|---|
| Context Compression | 11 | 4 | May 19, 2026 |
|---|
| Open-ended Dialogue | 11 | 2 | May 15, 2026 |
|---|
| Survey Generation | 11 | 4 | Jul 3, 2026 |
|---|
| Instruction-driven 3D layout generation | 11 | 1 | May 11, 2026 |
|---|
| Circuit Recovery | 11 | 1 | Apr 28, 2026 |
|---|
| Memory-augmented Question Answering | 11 | 8 | Jun 23, 2026 |
|---|
| Multimodal Understanding and Reasoning | 11 | 9 | Jun 18, 2026 |
|---|
| Open-ended instruction following | 11 | 5 | Jun 11, 2026 |
|---|