GSM-Symbolic
Benchmarks
TaskDatasetSOTA resultTrendResults
GSM-Symbolic
82.1GSM-Sym Accuracy
73
GSM-Symbolic Origin 100
96Accuracy
36
GSM-Symbolic Vary Both
90.22Accuracy
36
GSM-Symbolic Vary Name
92.48Accuracy
36
GSM-Symbolic Vary Num.
90.66Accuracy
36
GSM-Symbolic (test)
88.1Accuracy
24
GSM-Symbolic
88.12Avg@4 Accuracy
18
GSM-Symbolic
90.2Accuracy (Vary Both)
14
GSM-symbolic P2
88.4Accuracy
10
GSM-Symbolic
90Accuracy
9
GSM-Symbolic
49.6Accuracy
8
GSM-Symbolic-P2
82Pass@1 Score
6
GSM-Symbolic-P1
89Pass@1 Accuracy
6
GSM-Symbolic
93Pass@1
6
GSM-Symbolic (test)
66Accuracy (%)
4