GSM-Hard
Benchmarks
TaskDatasetSOTA resultTrendResults
GSM-Hard (test)
55.94Accuracy
30
GSM-Hard OOD
19Greedy Accuracy
23
GSM-Hard OOD 1.0 (test)
12Greedy Success Rate
9
GSM-Hard Natural Language version (test)
18.27Accuracy
5
GSM-Hard Out-of-Distribution (test)
71Final Answer Accuracy
5