Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Belief Prediction | 2 | 2 | May 22, 2026 | |
| grade-school math | 2 | 3 | Jun 30, 2026 | |
| Human-AI Agreement Assessment | 2 | 1 | Mar 26, 2026 | |
| Dialogue Simulation | 2 | 2 | Apr 10, 2026 | |
| Conversational Performance | 2 | 5 | Feb 18, 2026 | |
| Sister Tasks | 2 | 1 | Apr 20, 2026 | |
| Instruction-Guided Grading | 2 | 1 | Apr 2, 2026 | |
| LLM Chat Evaluation | 2 | 2 | Jun 2, 2026 | |
| General Knowledge and Instruction Following | 2 | 1 | Mar 27, 2026 | |
| Islamic inheritance reasoning |
|---|
| 2 |
| 2 |
| Apr 21, 2026 |
| Human Logic Alignment | 2 | 1 | Feb 18, 2026 |
|---|
| Leaderboard Evaluation | 2 | 1 | Mar 4, 2026 |
|---|
| Uncovering hidden system prompts | 2 | 1 | Mar 25, 2026 |
|---|
| Pairwise comparison evaluation | 2 | 1 | Mar 4, 2026 |
|---|
| Knowledge Pair-wise Diversity | 2 | 1 | Feb 18, 2026 |
|---|
| Instructed Code Generation | 2 | 1 | Mar 25, 2026 |
|---|
| Generative Hallucination Evaluation | 2 | 3 | May 28, 2026 |
|---|
| General Knowledge Assessment | 2 | 8 | Jun 9, 2026 |
|---|
| Multi-agent Negotiation | 2 | 2 | Apr 23, 2026 |
|---|
| general character task | 2 | 1 | Mar 4, 2026 |
|---|
| Standard Operating Procedure execution | 2 | 1 | Mar 25, 2026 |
|---|
| Mathematical Calculation | 2 | 2 | Apr 10, 2026 |
|---|
| Visual Search and Reasoning | 2 | 2 | May 27, 2026 |
|---|
| General Language Capabilities | 2 | 2 | May 13, 2026 |
|---|
| Copy | 2 | 1 | Mar 4, 2026 |
|---|