CMMLU
Benchmarks
TaskDatasetSOTA resultTrendResults
CMMLU
86.48Accuracy
69
CMMLU
90.1Accuracy
65
CMMLU
89.5Accuracy
50
CMMLU (test)
78.3Accuracy
38
CMMLU
89.44Accuracy
33
CMMLU
81.5Score
32
CMMLU
90.9Accuracy
25
CMMLU
84.72Knowledge Score
25
CMMLU
61.3Score
20
CMMLU
77.01Score
14
CMMLU
77.3Overall Accuracy
14
CMMLU (test)
68.1Accuracy
14
CMMLU (test)
0.574CMMLU Score
13
CMMLU
90.9Score
10
CMMLU (test)
64.1Accuracy
8
CMMLU
53.45Score
8
Cmmlu_c
36.88Accuracy
7
CMMLU
61.9CMMLU College Mathematics Accuracy
6
CMMLU
88.1Accuracy
6
CMMLU
71.8CMMLU Score
6
CMMLU Med
86.89Accuracy
5
CMMLU
63.4Accuracy
4
CMMLU
0.865Accuracy
4
CMMLU
90.8Exact Match (EM)
3
CMMLU
0.57Accuracy (Reasoning)
3