AMC
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
AMC 2023
90Accuracy
32
AMC 23
79.3Avg@32
31
AMC23
68.3Accuracy
30
AMC
82.7Pass@1
29
AMC 2023
12.7Latency (s)
29
AMC 2023
26,854.97Input Tokens
29
AMC 2023
87.5Avg@16
29
AMC23
77.6Avg@16
29
AMC23
92.7Mean Score @12
28
AMC 23
93.3Acc
28
AMC 2023
97.81Accuracy (avg@k)
27
AMC
47.29Avg@8 Accuracy
27
AMC
71.08Pass@8
27
AMC
78.36Pass@1
27
AMC
79.52Acc@8
27
AMC 23
80.74Accuracy (@avg1)
27
AMC 2023
86.75Avg@32
27
AMC 2023
73.6Pass@1
26
AMC 2023
90.5Accuracy
26
AMC 2023
100Accuracy
26
AMC23
84.38Avg@16 Accuracy
25
AMC23
93.1AVG@8
25
AMC 23
46.72Avg@16
24
AMC
88.6Pass@1
24
AMC23
62.19Avg@k
24