Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Jailbreak Transferability | 4 | 1 | Mar 4, 2026 | |
| False Refusal Evaluation | 4 | 2 | Mar 17, 2026 | |
| Attribute Steering | 4 | 3 | May 13, 2026 | |
| Multi-digit Multiplication | 4 | 1 | Apr 21, 2026 | |
| PII Disclosure Mitigation | 4 | 1 | Apr 21, 2026 | |
| Pairwise Human Preference Prediction | 4 | 2 | May 6, 2026 | |
| Constrained LLM Decoding | 4 | 1 | Feb 18, 2026 | |
| Troubleshooting | 4 | 2 | Mar 13, 2026 | |
| Steerability Correlation Analysis |
| 4 |
| 1 |
| Apr 20, 2026 |
| Personality Alignment | 4 | 2 | May 1, 2026 |
|---|
| Personality Understanding | 4 | 2 | May 8, 2026 |
|---|
| Zero-shot Language Understanding and Reasoning | 4 | 4 | Apr 2, 2026 |
|---|
| Response-level Hallucination Detection | 4 | 2 | Jul 7, 2026 |
|---|
| Multi-Query Associative Recall (MQAR) | 4 | 1 | Feb 18, 2026 |
|---|
| Multi-Task | 4 | 3 | Jun 23, 2026 |
|---|
| Chat & Instruction Following | 4 | 2 | Jul 7, 2026 |
|---|
| Tool-use behavioral profiling | 4 | 1 | Apr 15, 2026 |
|---|
| Long-Horizon Stability | 4 | 2 | May 14, 2026 |
|---|
| Multilingual Reasoning and Language Understanding | 4 | 1 | Apr 15, 2026 |
|---|
| MemoryBench Task | 4 | 1 | Feb 18, 2026 |
|---|
| Dialogue Reasoning | 4 | 5 | May 15, 2026 |
|---|
| Knowledge Editing Resistance | 4 | 1 | Jul 3, 2026 |
|---|
| Modular Addition | 4 | 2 | Jul 1, 2026 |
|---|
| Reasoning-Aware Threat Detection | 4 | 1 | Mar 4, 2026 |
|---|
| Multilingual Knowledge Evaluation | 4 | 4 | Jun 8, 2026 |
|---|