Math Reasoning Tasks
Benchmarks
TaskDatasetSOTA resultTrendResults
Math Reasoning Tasks
83.5AUC
56
Math Reasoning Tasks (MultiArith, GSM8K, AddSub, AQUA, SingleEq, SVAMP, MAWPS) (test)
99.7MultiArith
23
Math Reasoning Tasks Group 1
61.8MATH500 Score
11
Math Reasoning Tasks Task-average (test)
41.5Pass@1
9
Math Reasoning Tasks AIME, MATH500, GSM8K, AMC aggregated (test)
64.04Pass@k Score
9
Math reasoning tasks
67.43Math Avg. Pass@4 (Before)
4