ArenaHard
Benchmarks
TaskDatasetSOTA resultTrendResults
ArenaHard
72Score
20
ArenaHard
49.2Accuracy
17
ArenaHard
50Accuracy
17
ArenaHard v1
38ArenaHardv1 Score
14
ArenaHard creative writing v2.0
29WR Score
13
ArenaHard Creative Writing 2.0
61.9Win Rate
12
ArenaHard Hard Prompts 2.0
32.7Win Rate
12
ArenaHard v2.0
52Win Rate
12
ArenaHard v1.0
82.75Win Rate
12
ArenaHard v2
15.5Hard Prompt Score
8
ArenaHard
95.7pass@1
7
ArenaHard v2
81.6Score
6
ArenaHard
76.5Hard-Prompt Avg Score
6
ArenaHard v2
57.4ArenaHard v2 Score
6
ArenaHard V2
60Avg@3 Score
6
ArenaHard Hard Prompt v2
88.2Pass@1
4
ArenaHard
13.88Win Rate
3
ArenaHard v2
89ArenaHard-v2 Creative Accuracy
3
ArenaHard Creative Writing v2
78.7Pass@1
3
ArenaHard Avg. v2
83.5Pass@1
3