List your company
ResearchFormerly WizWand

Math Word Problem solving on MAWPS English (test)

93AccuracyATHENA
82.18484.99287.890.608Nov 2, 2023
Updated 8mo ago

Evaluation results

MethodLinks
ATHENABackbone=RoBERTa-large2023.1193
DeductReasonerBackbone=RoBERTa-large2023.1192.6
ATHENABackbone=RoBERTa-base2023.1192.2
DeductReasonerBackbone=RoBERTa-base2023.1192
R-Graph-to-TreeBackbone=RoBERTa-base2023.1188.7
R-GTSBackbone=RoBERTa-base2023.1188.5
R-TransformerBackbone=RoBERTa-base2023.1188.4
TransformerBackbone=Random embedding2023.1185.6
Graph-to-TreeBackbone=Random embedding2023.1183.7
GTSBackbone=Random embedding2023.1182.6