Math Word Problem Solving on Illinois (IL) 562 single-step word problems (5-fold cross-validation)
83.2AccuracyGiving BERT a Calculator
Evaluation Results
| Method | Links | |
|---|---|---|
| Giving BERT a CalculatorTraining data=Pre-trained on DROP, fine-tuned on IL data, Operations=Sum, Diff, Mul, and Div2019.08 | 83.2 | |
| Liang et al.year=20162019.08 | 80.1 | |
| Giving BERT a CalculatorTraining data=IL data only, Operations=Sum, Diff, Mul, and Div2019.08 | 74 | |
| Roy et al.year=20152019.08 | 73.9 | |
| Wang et al.year=20182019.08 | 73.3 | |
| Giving BERT a CalculatorTraining data=IL data only, Operations=Sum and Diff2019.08 | 48.6 | |
| SAU-Solverevaluation_protocol=5-fold cross-validation2020.10 | 44.83 | |
| SAU-Solver w/o SSARevaluation_protocol=5-fold cross-validation2020.10 | 44.4 | |
| StackDecoderevaluation_protocol=5-fold cross-validation2020.10 | 27.4 | |
| Seq2Seq-attn w/ SNIevaluation_protocol=5-fold cross-validation2020.10 | 23.2 |