AMC
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
AMC23
95Maj@16
8
AMC 2023 (test)
65Maj@16
8
AMC 2023
86.09Accuracy
8
AMC 23
47.66Performance (%)
8
AMC 83 samples
59.32Accuracy (AMC 83)
8
AMC 2024 (test)
49.3Pass@1
8
amc 23
72.5Accuracy (%)
8
AMC
82Accuracy
8
AMC 23
74.7Avg@16 Accuracy
8
AMC23
66.4Accuracy (%)
7
AMC23
70Pass@1 Accuracy
7
AMC23
46.5Pass@1 Score
7
AMC 23
95.6Pass@32
7
AMC (test)
74.23Pass@4
7
AMC23
87.5Avg@8 Score
7
AMC 23
93Average Accuracy @16
7
AMC 23
82.1Avg@16 Score
7
AMC
57.5Accuracy (AMC)
7
AMC23
96.2Mean@16
6
AMC (External Dataset, n=500)
0.146BLEU
6
AMC 50 randomly sampled cases
6.979Average Score
6
AMC
71.2Pass@1 Score (mean@32)
6
AMC
71.69Pass@1
6
AMC 23
68.4maj@8
6
AMC 2023 (test)
90Accuracy
6