ARC
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
ARC C
88T Score
14
ARC Easy (held-out)
55.4Pass@2 Accuracy
14
ARC Challenge
73.21Accuracy
14
ARC-E
17,290Training Memory (MB)
14
ARC
63.4ARCe Accuracy
14
ARC Challenge
86.73Pass@1
14
ARC-C 24 official EU languages
93.1Score
14
ARC hard
40.43Accuracy
14
ARC
25.8Accuracy
13
ARC Easy
95.9Accuracy
13
ARC Challenge
81Pass@1 Score
13
ARC-C
55.39Accuracy (ARC-C)
13
ARC-C
82.9Accuracy
13
ARC Challenge
51.5ARC-C Accuracy
12
ARC Easy
2.36CPR
12
ARC-E
91.2Accuracy
12
ARC 1
79.6Pass@2
12
ARC Challenge
64.5WP-AUC
12
ARC-C
87.75Accuracy
12
ARC Challenge
92Accuracy
12
ARC Easy
93.2Accuracy
12
ARC Challenge French
32.59Accuracy
12
ARC Challenge
21.08P@1
12
ARC Easy
24.24P@1
12
ARC
96.2Pass@1
12