List your company
ResearchFormerly WizWand

Math Word Problem Solving on Illinois (IL) 562 single-step word problems (5-fold cross-validation)

83.2AccuracyGiving BERT a Calculator
20.83753.269.4Aug 31, 2019Nov 7, 2019Jan 14, 2020Mar 23, 2020May 30, 2020Aug 6, 2020Oct 14, 2020
Updated 8mo ago

Evaluation results

MethodLinks
Giving BERT a CalculatorTraining data=Pre-trained on DROP, fine-tuned on IL data, Operations=Sum, Diff, Mul, and Div2019.0883.2
Liang et al.year=20162019.0880.1
Giving BERT a CalculatorTraining data=IL data only, Operations=Sum, Diff, Mul, and Div2019.0874
Roy et al.year=20152019.0873.9
Wang et al.year=20182019.0873.3
Giving BERT a CalculatorTraining data=IL data only, Operations=Sum and Diff2019.0848.6
SAU-Solverevaluation_protocol=5-fold cross-validation2020.1044.83
SAU-Solver w/o SSARevaluation_protocol=5-fold cross-validation2020.1044.4
StackDecoderevaluation_protocol=5-fold cross-validation2020.1027.4
Seq2Seq-attn w/ SNIevaluation_protocol=5-fold cross-validation2020.1023.2