Math Domain
Benchmarks
TaskDatasetSOTA resultTrendResults
Math domain
2.86Average Generation Time (s)
40
Math Domain (AIME24, Math-OAI, Minerva, Olympiad, ACM23) Qwen2.5-7B (10% selection)
7.71AIME24 Score
18
Math Domain (Out-of-Domain: MATH500, AIME24, Minerva-Math, AMC23)
91.8MATH500 Score
11
Math Domain In-Domain
91MATH500
11
Math Domain
66.45Avg Accuracy
7