AMC
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
AMC 22-23
85.7Accuracy
13
AMC
75.1Avg@16
13
AMC 23
87.5Pass@1 Accuracy
12
AMC 2023 (test)
36.67Pass@1
12
AMC 23
55.57Mean@16
12
AMC23
86.67Accuracy (AMC23)
12
AMC23
71.25Avg@8 Accuracy
12
AMC 23
6,768Response Length (Tokens)
12
AMC 23
42.19Avg@8
12
AMC 23
42.19Avg@8
12
AMC23
77.5EM Accuracy
12
AMC 2023
97.5Accuracy
12
AMC 22 23
83.4Mean@4
12
AMC 23
96.6Average Score
12
AMC 23
95Accuracy
12
AMC 2023
62.5Accuracy
12
AMC23
11.08Average Count of Unique Outputs
12
AMC'23
0Avg Max Probability Divergence
12
AMC23
100Training Steps
12
AMC 2023 (test)
68.7Avg@8 Success Rate
12
AMC23
95Accuracy
12
AMC 2023
85Peak Accuracy
12
AMC 23
84.2Peak Accuracy
12
AMC (test)
74.1Accuracy
12
AMC23
65.21Accuracy
12