Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Arena-Hard-Auto dataset and benchmarks · SOTA2 Research

Research Datasets

Arena-Hard-Auto

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Open-ended query evaluation

Arena-Hard-Auto v0.1

31.5Win Rate

14

Chat Performance

Arena-Hard-Auto

92.8Score

6

Open-ended instruction following

Arena-Hard-Auto v2.0

51.8Win Rate (Response)

3

Popular tasks

Open-ended instruction following Chat Performance Open-ended query evaluation

Follow for updates

Join SOTA2 Contact