ARC
Benchmarks
TaskDatasetSOTA resultTrendResults
ARC Challenge
96.3Accuracy
906
ARC Challenge
87.3Accuracy (ARC)
631
ARC Easy
98.2Accuracy
597
ARC-E
95.23Accuracy
544
ARC Easy
96.4Normalized Acc
420
ARC Challenge
96Accuracy
354
ARC-C
94.1Accuracy
283
ARC Easy
99.7Accuracy
269
ARC
94.5Accuracy
269
ARC-C
96.3Accuracy
268
ARC Challenge
97.35Accuracy
259
ARC-E
96.56Accuracy
249
ARC Easy
90.48Accuracy
246
ARC Easy
96.63Accuracy
242
ARC-E
97.53Accuracy
240
ARC
94.6Accuracy
230
ARC-C
96.3Accuracy
225
ARC Easy
98Accuracy
162
ARC (test)
90.5Accuracy
153
ARC easy
93.27ARC (easy) Accuracy
149
ARC Challenge
74.7Acc
133
ARC Challenge
92.5Accuracy
121
ARC-C
0.71Accuracy
116
ARC-c
96.3Accuracy (ARC-c)
113
ARC Challenge
93Accuracy
111