AMC
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
AMC 2023
96.3Avg@32
24
AMC
59.5Mean Accuracy
24
AMC23 (val)
80Accuracy
24
AMC
1.7Latency (s)
24
AMC
0.1C_mem (Ratio)
24
AMC
68.2Accuracy (%)
23
AMC 2023
91.9pass@8
23
AMC 23
74.84Accuracy
23
AMC 2023
68.5Pass@1
22
AMC 2023
67.5AMC 2023 Score
21
AMC 2023
96.9Accuracy
21
AMC23
52.58Pass@1
21
AMC 2023
90.63Accuracy (AMC 2023)
21
AMC
73.45Avg@32
21
AMC
50.84Avg@10 Score
21
AMC 23
82.81Mean@32
20
AMC
89.2Accuracy
20
AMC 23
66.5P@1
20
AMC 23
95.1Avg@32
20
AMC 23
78.8Pass@1
20
AMC23
67.8Pass Rate (Avg@8)
20
AMC23
90.62Avg@16
19
AMC 2024
49.8Pass@1
19
AMC 2023
82.5Pass@1
19
AMC23 In-Domain (test)
72.5Accuracy
18