List your company
ResearchFormerly WizWand

Math Word Problem Solving on Math Word Problems 6 tasks

43.1AccuracyMIDAS
16.26823.23430.237.166Sep 27, 2024
Updated 8mo ago

Evaluation results

MethodLinks
MIDASParameters=8B, d(i)/i (block size)=9, Schedule=PROP-2, Speedup=1.26x2024.0943.1
MIDASParameters=2B, d(i)/i (block size)=8, Schedule=PROP-2, Speedup=1.24x2024.0938.2
BaselineParameters=8B, d(i)/i (block size)=72, Schedule=1x, Speedup=1x2024.0934.9
MIDASParameters=1B, d(i)/i (block size)=4, Schedule=PROP-3, Speedup=1.16x2024.0933.3
MIDASParameters=2B, d(i)/i (block size)=8, Schedule=PROP-1, Speedup=1.39x2024.0932
MIDASParameters=1B, d(i)/i (block size)=4, Schedule=PROP-1, Speedup=1.39x2024.0930.3
MIDASParameters=1B, d(i)/i (block size)=3, Schedule=PROP-2, Speedup=1.26x2024.0929.8
MIDASParameters=1B, d(i)/i (block size)=4, Schedule=PROP-2, Speedup=1.24x2024.0929
BaselineParameters=2B, d(i)/i (block size)=48, Schedule=1x, Speedup=1x2024.0927.1
MIDASParameters=1B, d(i)/i (block size)=3, Schedule=PROP-1, Speedup=1.41x2024.0927
GRADSTACKParameters=2B, d(i)/i (block size)=8, Schedule=PROP-2, Speedup=1.24x2024.0924.5
BaselineParameters=1B, d(i)/i (block size)=24, Schedule=1x, Speedup=1x2024.0923.5
GRADSTACKParameters=1B, d(i)/i (block size)=4, Schedule=PROP-1, Speedup=1.39x2024.0923.5
GRADSTACKParameters=1B, d(i)/i (block size)=4, Schedule=PROP-2, Speedup=1.24x2024.0917.3