Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Retrieval-Augmented Generation (RAG) | 2 | 1 | Feb 18, 2026 | |
| Hard Reasoning | 2 | 3 | Jun 11, 2026 | |
| Chain-of-Thought Quality | 2 | 1 | Apr 30, 2026 | |
| Sister Tasks | 2 | 1 | Apr 20, 2026 | |
| Loop Suppression | 2 | 1 | Apr 14, 2026 | |
| Memory Updating | 2 | 3 | Jun 25, 2026 | |
| Graduate-level Q&A | 2 | 2 | Apr 30, 2026 | |
| Conversational Numerical Reasoning Question Answering | 2 | 1 | Feb 18, 2026 | |
| Reward Modeling Suitability Evaluation |
| 2 |
| 1 |
| Feb 19, 2026 |
| General Agent Capability | 2 | 2 | Apr 16, 2026 |
|---|
| Construct Validity Verification | 2 | 1 | Apr 9, 2026 |
|---|
| Personality Recovery | 2 | 1 | Apr 8, 2026 |
|---|
| Pun Explanation | 2 | 1 | Apr 8, 2026 |
|---|
| Agreement with outcome human labels | 2 | 1 | Apr 9, 2026 |
|---|
| Harmful Question Forgetting | 2 | 1 | Apr 8, 2026 |
|---|
| Locality | 2 | 1 | Apr 8, 2026 |
|---|
| Scientific Verification | 2 | 1 | Apr 8, 2026 |
|---|
| Agreement with process human labels | 2 | 1 | Apr 9, 2026 |
|---|
| Concept Forgetting | 2 | 1 | Apr 8, 2026 |
|---|
| EDA | 2 | 1 | Feb 18, 2026 |
|---|
| Language Modeling Downstream Evaluation | 2 | 3 | Jun 16, 2026 |
|---|
| Multi-turn Jailbreaking | 2 | 2 | May 12, 2026 |
|---|
| Citation Coverage Evaluation | 2 | 1 | Apr 8, 2026 |
|---|
| Factuality Hallucination | 2 | 1 | Feb 18, 2026 |
|---|
| Agentic medical interaction | 2 | 1 | Apr 8, 2026 |
|---|