Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Pair-wise Research Idea Comparison | 2 | 1 | Feb 22, 2026 | |
| Engineering problem-solving | 2 | 2 | Apr 21, 2026 | |
| Knowledge & QA | 2 | 2 | Jun 11, 2026 | |
| LLM-as-Judge evaluation | 2 | 2 | Apr 29, 2026 | |
| Pluralistic Reward Model Learning | 2 | 1 | Mar 31, 2026 | |
| RLHF Alignment | 2 | 2 | Apr 20, 2026 | |
| Episodic Memory | 2 | 1 | Feb 22, 2026 | |
| Biomedical Reasoning | 2 | 2 | Feb 19, 2026 | |
| Long-context Multimodal Understanding |
| 2 |
| 2 |
| May 15, 2026 |
| Multi-task Knowledge Understanding | 2 | 4 | Jun 25, 2026 |
|---|
| Long-term Memory Retrieval | 2 | 3 | May 28, 2026 |
|---|
| Veracity Explanation Ranking | 2 | 2 | Feb 18, 2026 |
|---|
| Knowledge-intensive Dialogue | 2 | 1 | Feb 22, 2026 |
|---|
| Dialogue Annotation | 2 | 1 | Apr 6, 2026 |
|---|
| General Alignment | 2 | 2 | May 14, 2026 |
|---|
| Tutoring Evaluation | 2 | 2 | May 29, 2026 |
|---|
| Deception Evaluation | 2 | 1 | Mar 31, 2026 |
|---|
| Personality control | 2 | 3 | Apr 16, 2026 |
|---|
| Sequential Multi-Task Learning | 2 | 1 | Mar 30, 2026 |
|---|
| Difficulty | 2 | 1 | Feb 18, 2026 |
|---|
| Long-term preference alignment | 2 | 1 | Mar 27, 2026 |
|---|
| Long-Horizon Search Intelligence | 2 | 1 | Mar 27, 2026 |
|---|
| General Knowledge and Instruction Following | 2 | 1 | Mar 27, 2026 |
|---|
| Interactive query answering | 2 | 1 | Mar 27, 2026 |
|---|
| Secure LLM Agent Task Completion | 2 | 2 | Jun 9, 2026 |
|---|