Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| First-Last XOR | 1 | 1 | May 11, 2026 | |
| Crafting ace items | 1 | 1 | Feb 18, 2026 | |
| Reasoning-intensive classification | 1 | 1 | Feb 25, 2026 | |
| Expert-level Science Reasoning | 1 | 1 | May 11, 2026 | |
| Grokking Detection | 1 | 1 | May 12, 2026 | |
| Language Modeling Utility | 1 | 1 | Feb 27, 2026 | |
| Grokking transition detection | 1 | 1 | May 12, 2026 | |
| General Ability Evaluation | 1 | 1 | Feb 18, 2026 | |
| Behavioral Axis Detection |
| 1 |
| 1 |
| May 12, 2026 |
| Zero-shot tasks | 1 | 2 | Jul 2, 2026 |
|---|
| Text-based Role Play | 1 | 1 | May 12, 2026 |
|---|
| Expert Routing Consistency Analysis | 1 | 1 | Mar 4, 2026 |
|---|
| Multimodal Role-Play (T2T2I) | 1 | 1 | May 12, 2026 |
|---|
| Broad knowledge integration | 1 | 1 | May 12, 2026 |
|---|
| Enterprise Task Execution | 1 | 1 | May 12, 2026 |
|---|
| Multiple-Answer Question Answering | 1 | 2 | Jun 2, 2026 |
|---|
| Multi-agent consensus coordination | 1 | 1 | May 12, 2026 |
|---|
| Retrieval and reasoning | 1 | 1 | May 12, 2026 |
|---|
| Decision Alignment | 1 | 1 | May 12, 2026 |
|---|
| Long-form Factuality Calibration | 1 | 1 | Mar 4, 2026 |
|---|
| Multi-bit Text Watermarking | 1 | 1 | May 12, 2026 |
|---|
| End-to-end answer accuracy | 1 | 1 | May 12, 2026 |
|---|
| Multi-way preference ranking | 1 | 2 | May 12, 2026 |
|---|
| Membership Auditing | 1 | 1 | May 12, 2026 |
|---|
| Alignment ranking evaluation | 1 | 1 | Feb 18, 2026 |
|---|