ARC
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
ARC-C
98Accuracy
35
ARC-c
65.8Accuracy
34
ARC Challenge
56.4Normalized Accuracy
33
ARC Challenge
94.58ARC Score
33
ARCc
53.67Accuracy
32
ARC-C
92.5Accuracy
32
ARC-Challenge 0-shot
57.2Accuracy
31
ARC Easy
99.54ARC-E Score
31
ARC Challenge
96.43ARC-C Score
31
ARC-C (test)
92.49Accuracy
30
ARC
88.68pass@1
30
ARC Challenge
88.2Accuracy (ACC)
29
ARC-E
89.88Accuracy
29
ARC
86.41Score
29
ARC-E
98.1First-Token Accuracy
28
ARC-C 25-shot
62.43Score
28
Arc-C
79.81Accuracy
28
ARC-C
88.23Accuracy
28
ARC Easy
78.37ARC-e Accuracy
27
ARC Challenge
47.61ARC-c Score
27
ARC Easy
87.58Accuracy
26
ARC C
51.47Accuracy (ARC-C)
25
ARC Challenging
96.3Best Accuracy
25
ARC-Easy zero-shot (test)
94.2Accuracy
25
ARC
89.6Accuracy
25