LiveBench
Benchmarks
TaskDatasetSOTA resultTrendResults
LiveBench Reasoning
92Accuracy
80
LiveBench
53.47Accuracy
55
LiveBench
31.1Accuracy
40
LiveBench (test)
99.07Mean θtest
34
LiveBench (test)
56.5Sig. Score
26
LiveBench
49.6Official Score
24
LiveBench
42.9Avg@8
22
LiveBench
58.7Signal
21
LiveBench
31.1Accuracy
17
LiveBench Math
58.1Initial Task Score
16
LiveBench
33Accuracy
16
LiveBench
46.83Accuracy
15
LiveBench
40.23Accuracy
15
LiveBench
72.8Average Score
12
LiveBench
31.1Accuracy
12
LiveBench
53.6Accuracy
12
LiveBench
20.39Pass@10
8
LiveBench
0.691DINO Feature Similarity (FG)
8
LiveBench
20.132PSNR (Background)
8
LiveBench IFEval
100Quality
6
LiveBench
55.39Average Instruction Following Score
6
LiveBench 1125
52.1Score
6
LiveBench 2024-11-25
75.9Accuracy
5
LiveBench Math (test)
51.95Score
5
LiveBench 2024-11-25
70.79Score
5