Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

MultiChallenge dataset and benchmarks · SOTA2 Research

Research Datasets

MultiChallenge

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Instruction Following

MultiChallenge

69.3Score

26

Instruction Following

MultiChallenge (Out-of-Domain)

38.5Overall Score

23

Reverse Chain-of-Thought Generation

MultiChallenge

45Score

20

General-purpose Behavior

MultiChallenge

58.6Score

7

Turn-level correlation with human ratings

MultiChallenge

0.74Spearman Correlation

6

Session-level correlation with human ratings

MultiChallenge

0.74Spearman Correlation (ρ)

6

Long-context & Multi-turn Dialogue

Multichallenge

39.71Score

4

Multi-turn Dialogue Reasoning

MultiChallenge

32.97Accuracy

4

Medical Instruction Following

MultiChallenge

66.8Pass@1

4

Relational Understanding

MultiChallenge

20.35IM Score

2

Popular tasks

Instruction Following Multi-turn Dialogue Reasoning Relational Understanding General-purpose Behavior Medical Instruction Following

Follow for updates

Join SOTA2 Contact