Math Word Problem Solving on Math Word Problems 6 tasks
43.1AccuracyMIDAS
Evaluation Results
| Method | Links | |
|---|---|---|
| MIDASParameters=8B, d(i)/i (block size)=9, Schedule=PROP-2, Speedup=1.26x2024.09 | 43.1 | |
| MIDASParameters=2B, d(i)/i (block size)=8, Schedule=PROP-2, Speedup=1.24x2024.09 | 38.2 | |
| BaselineParameters=8B, d(i)/i (block size)=72, Schedule=1x, Speedup=1x2024.09 | 34.9 | |
| MIDASParameters=1B, d(i)/i (block size)=4, Schedule=PROP-3, Speedup=1.16x2024.09 | 33.3 | |
| MIDASParameters=2B, d(i)/i (block size)=8, Schedule=PROP-1, Speedup=1.39x2024.09 | 32 | |
| MIDASParameters=1B, d(i)/i (block size)=4, Schedule=PROP-1, Speedup=1.39x2024.09 | 30.3 | |
| MIDASParameters=1B, d(i)/i (block size)=3, Schedule=PROP-2, Speedup=1.26x2024.09 | 29.8 | |
| MIDASParameters=1B, d(i)/i (block size)=4, Schedule=PROP-2, Speedup=1.24x2024.09 | 29 | |
| BaselineParameters=2B, d(i)/i (block size)=48, Schedule=1x, Speedup=1x2024.09 | 27.1 | |
| MIDASParameters=1B, d(i)/i (block size)=3, Schedule=PROP-1, Speedup=1.41x2024.09 | 27 | |
| GRADSTACKParameters=2B, d(i)/i (block size)=8, Schedule=PROP-2, Speedup=1.24x2024.09 | 24.5 | |
| BaselineParameters=1B, d(i)/i (block size)=24, Schedule=1x, Speedup=1x2024.09 | 23.5 | |
| GRADSTACKParameters=1B, d(i)/i (block size)=4, Schedule=PROP-1, Speedup=1.39x2024.09 | 23.5 | |
| GRADSTACKParameters=1B, d(i)/i (block size)=4, Schedule=PROP-2, Speedup=1.24x2024.09 | 17.3 |