Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Response style evaluation | 1 | 1 | Mar 12, 2026 | |
| Agent preference prediction | 1 | 1 | May 25, 2026 | |
| Counterfactual sensitivity | 1 | 1 | Jun 11, 2026 | |
| Chat Preference | 1 | 2 | Mar 4, 2026 | |
| Alignment Preference Selection | 1 | 1 | May 25, 2026 | |
| Proxy Consistency Evaluation | 1 | 1 | Feb 19, 2026 | |
| Reasoning Token Consumption Analysis | 1 | 1 | Mar 12, 2026 | |
| Standardized Exam Reasoning | 1 | 1 | May 25, 2026 | |
| Factual Knowledge Editing |
| 1 |
| 1 |
| Mar 12, 2026 |
| Multi-Domain Language Modeling and Reasoning | 1 | 1 | Feb 19, 2026 |
|---|
| Pronoun Steering | 1 | 1 | Mar 12, 2026 |
|---|
| Commonsense and Logical Reasoning | 1 | 1 | May 26, 2026 |
|---|
| Knowledge Model Editing | 1 | 1 | Mar 24, 2026 |
|---|
| Response Safety Alignment | 1 | 1 | Jun 11, 2026 |
|---|
| Talking to Others | 1 | 1 | May 26, 2026 |
|---|
| Multi-Turn Session | 1 | 1 | May 26, 2026 |
|---|
| Method ranking self-consistency | 1 | 1 | Mar 12, 2026 |
|---|
| General-domain Persuasion Robustness | 1 | 1 | May 26, 2026 |
|---|
| Logical Reasoning Reliability Evaluation | 1 | 1 | May 26, 2026 |
|---|
| Human consistency correlation | 1 | 1 | Mar 12, 2026 |
|---|
| Logic Consistency Evaluation | 1 | 1 | May 26, 2026 |
|---|
| Open-ended Information Seeking | 1 | 1 | Feb 19, 2026 |
|---|
| Long-text Question Answering | 1 | 1 | Mar 13, 2026 |
|---|
| Subjective evaluation of research ideas | 1 | 1 | May 26, 2026 |
|---|
| Sparse Decoding (MHA) | 1 | 1 | May 26, 2026 |
|---|