Arena-Hard
Benchmarks
TaskDatasetSOTA resultTrendResults
Arena-Hard v2 (test)
1.3AH2 Score
8
Arena-Hard v2.0
65.8Quality
6
Arena-Hard v0.1 (test)
40.1Win Rate
6
Arena-Hard Creative Writing
93.6Score
6
Arena-Hard Prompt
72.6Score
6
Arena Hard v0.1
46.5Win Rate
5
Arena-Hard Style-Controlled
46.1Win-rate
5
Arena-Hard Vanilla
0.492Win Rate
5
Arena-Hard RU
92.69Best@8 Score
5
Arena-Hard V2
72.8Accuracy
4
Arena-Hard CW
28.4Score
4
Arena Hard English v2.0
55.78Coding Accuracy
4
Arena-hard Creative-Writing
80.2Pairwise Win Rate
4
Arena-hard Hard-Prompt
58.5Pairwise Win Rate
4
Arena-Hard v2.0
74.8Top-5 Accuracy
3
Arena-Hard v2.0
39.2Score
3
Arena-Hard V2
90.26Win Rate
3
Arena-Hard 0.1
10.8WR (%)
3
Arena-Hard v0.1
56.7Win Rate
3