TaskDatasetSOTA resultTrendResults
MMLU
99.7Accuracy
881
MMLU
96.6Accuracy
844
MMLU
91.5Accuracy
568
MMLU
98.5MMLU Accuracy
456
MMLU
91.2MMLU General Knowledge Accuracy
373
MMLU
94.7Accuracy
353
MMLU (test)
92.16Accuracy
322
MMLU
90MMLU Accuracy
307
MMLU-Pro
89.31Accuracy
303
MMLU-Pro
92.86Accuracy
264
MMLU
86.3Accuracy
263
MMLU
97.5Accuracy
222
MMLU-Pro
82.3Accuracy
213
MMLU
0.002MAE
198
MMLU
95.1MMLU Accuracy
180
MMLU
85.93Accuracy
171
MMLU
83.66MMLU Accuracy
167
MMLU (test)
88MMLU Average Accuracy
167
MMLU 5-shot
90.58Accuracy
160
MMLU 5-shot (test)
74.2Accuracy
149
MMLU-Pro
91.43Accuracy
148
MMLU
87.56MMLU Accuracy
144
MMLU
83.29Accuracy
143
MMLU-Pro
96.5MMLU-Pro Overall Accuracy
138
MMLU
83.34Accuracy
137