Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Examination | 7 | 4 | Mar 11, 2026 | |
| LLM Steering | 7 | 2 | May 29, 2026 | |
| User Satisfaction Evaluation | 7 | 2 | Jul 3, 2026 | |
| Jailbreak Resistance | 7 | 3 | May 26, 2026 | |
| KV cache compression | 7 | 1 | Mar 31, 2026 | |
| End-to-End Inference | 7 | 4 | Jun 4, 2026 | |
| Grade School Math Reasoning | 7 | 16 | Jul 9, 2026 | |
| IPI Sanitization | 7 | 1 | Feb 19, 2026 | |
| Comparison-QA | 7 |
| 1 |
| Apr 8, 2026 |
| Multimodal Instruction Following | 7 | 11 | May 8, 2026 |
|---|
| Question Answering and Commonsense Reasoning | 7 | 8 | Jun 4, 2026 |
|---|
| Multi-subject customization | 7 | 3 | Mar 24, 2026 |
|---|
| Multi-turn ambiguous query clarification | 7 | 1 | Feb 19, 2026 |
|---|
| Medical Dialogue Generation | 6 | 4 | Jun 23, 2026 |
|---|
| Generative Performance | 6 | 2 | May 13, 2026 |
|---|
| Dialog Generation | 6 | 5 | May 22, 2026 |
|---|
| Multi-turn Visual Question Answering | 6 | 1 | Mar 24, 2026 |
|---|
| Utility | 6 | 4 | May 28, 2026 |
|---|
| Human alignment evaluation | 6 | 5 | Jun 16, 2026 |
|---|
| Episodic Memory Recall | 6 | 1 | Feb 22, 2026 |
|---|
| Quality Evaluation | 6 | 2 | Apr 14, 2026 |
|---|
| Text Alignment | 6 | 6 | Jun 11, 2026 |
|---|
| Robot Instruction Following | 6 | 2 | Jun 1, 2026 |
|---|
| Episodic Memory Retrieval | 6 | 1 | Feb 22, 2026 |
|---|
| Multistep Reasoning | 6 | 10 | Jun 4, 2026 |
|---|