List your company
ResearchFormerly WizWand

Math Reasoning on Math Word Problems (Math WPs) (test)

43.1AccuracyMIDAS
14.29221.77129.2536.729Sep 27, 2024
Updated 8mo ago

Evaluation results

MethodLinks
MIDASNumber of Parameters=8B, Shots=5, Calculator Usage=W calc.2024.0943.11.844
MIDASNumber of Parameters=2B, Shots=5, Calculator Usage=W calc.2024.0938.31.929
BaselineNumber of Parameters=8B, Shots=5, Calculator Usage=W calc.2024.0934.91.841
MIDASNumber of Parameters=8B, Shots=5, Calculator Usage=W/o calc.2024.0932.91.844
BaselineNumber of Parameters=8B, Shots=5, Calculator Usage=W/o calc.2024.0927.31.841
BaselineNumber of Parameters=2B, Shots=5, Calculator Usage=W calc.2024.0927.11.926
MIDASNumber of Parameters=2B, Shots=5, Calculator Usage=W/o calc.2024.0922.51.929
BaselineNumber of Parameters=2B, Shots=5, Calculator Usage=W/o calc.2024.0915.41.926