ARC
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
ARC-E
94.25Accuracy
25
ARC-C
92.56Accuracy
25
ARC Challenge
93.34Accuracy
25
ARC-Challenge
94.37Accuracy
24
ARC Challenge
418Solution Length
24
ARC Challenge
99.4Accuracy
24
ARC (test)
88.59Accuracy
24
ARC Easy
73.4Accuracy
24
ARC
0.752Median Dice
24
ARC easy
77.9Accuracy
23
ARC-C OOD Small Shift
81.6Accuracy
23
ARC Challenge
37.3ARC-Challenge Score
22
ARC-c
54.1Accuracy
22
ARC C
70.14Accuracy (ARC-C)
21
ARC-Challenge (ARC-C) (test)
53.7VWR
21
ARC Challenge
83.24Accuracy
21
ARC-e
85.1Accuracy
21
ARC (test)
64.81Accuracy
21
ARC-E
41.7Accuracy
21
ARC-E OOD Small Shift
87.27Accuracy
21
ARC-C
55.12ARC-C Score (x100)
21
ARC
94.62Accuracy
21
ARC Mean of Easy and Challenge
94.75Accuracy
20
Multilingual ARC-E 5 Unseen Languages
95.1ARC-E Accuracy
20
ARC Easy
67.26Normalized Accuracy
20