Loading the SOTA2 catalog…
SOTA2 Research · tasks
Explore the problems researchers are working on and the benchmarks used to measure progress.
| Task Name | Domain | Benchmarks | Papers | Last Update |
|---|---|---|---|---|
| Alignment Evaluation | 8 | 7 | Jun 2, 2026 | |
| Last-word prediction | 8 | 3 | Jun 16, 2026 | |
| General LLM Evaluation | 8 | 8 | May 28, 2026 | |
| Advanced Reasoning | 8 | 2 | Apr 10, 2026 | |
| Lifelong Knowledge Editing | 8 | 3 | Feb 19, 2026 | |
| Output Length Prediction | 8 | 2 | Apr 10, 2026 | |
| Answer Verification | 8 | 2 | Mar 18, 2026 | |
| LLM fingerprinting | 8 | 1 | Apr 15, 2026 | |
| Multi-turn task completion |
| 8 |
| 1 |
| Apr 10, 2026 |
| Response Quality | 8 | 2 | Apr 15, 2026 |
|---|
| Concept Identifiability | 8 | 1 | Mar 4, 2026 |
|---|
| Conversation | 8 | 9 | Jun 2, 2026 |
|---|
| Multi-path speculative decoding | 8 | 1 | Feb 22, 2026 |
|---|
| Task-Focused Dialogue | 8 | 1 | Feb 22, 2026 |
|---|
| Input Moderation | 8 | 4 | Jun 2, 2026 |
|---|
| General Knowledge Question Answering | 8 | 12 | Jun 11, 2026 |
|---|
| Chatbot Evaluation | 8 | 6 | May 22, 2026 |
|---|
| Global resource management and long-term strategic planning | 8 | 1 | Mar 26, 2026 |
|---|
| Character Relationship Network Updating | 8 | 1 | Apr 15, 2026 |
|---|
| Conversational Memory Retrieval | 8 | 3 | Jun 11, 2026 |
|---|
| General Language Evaluation | 8 | 9 | May 19, 2026 |
|---|
| Multi-turn interaction accuracy | 8 | 1 | Feb 18, 2026 |
|---|
| Feedback Evaluation | 8 | 3 | Mar 13, 2026 |
|---|
| Deep Research Report Generation | 8 | 12 | Jun 16, 2026 |
|---|
| Factual Reasoning | 7 | 3 | Jun 23, 2026 |
|---|