List your company
ResearchFormerly WizWand

General Downstream Evaluation on All Downstream Tasks 15 tasks

36.4Average Accuracy (All Tasks)MIDAS
19.7624.0828.432.72Sep 27, 2024
Updated 8mo ago

Evaluation results

MethodLinks
MIDASParameters=8B, d(i)/i (block size)=9, Schedule=PROP-2, Speedup=1.26x2024.0936.4
MIDASParameters=2B, d(i)/i (block size)=8, Schedule=PROP-2, Speedup=1.24x2024.0932.9
BaselineParameters=8B, d(i)/i (block size)=72, Schedule=1x, Speedup=1x2024.0932.8
MIDASParameters=2B, d(i)/i (block size)=8, Schedule=PROP-1, Speedup=1.39x2024.0929.5
MIDASParameters=1B, d(i)/i (block size)=4, Schedule=PROP-3, Speedup=1.16x2024.0928.3
BaselineParameters=2B, d(i)/i (block size)=48, Schedule=1x, Speedup=1x2024.0928
MIDASParameters=1B, d(i)/i (block size)=3, Schedule=PROP-2, Speedup=1.26x2024.0927.5
MIDASParameters=1B, d(i)/i (block size)=4, Schedule=PROP-2, Speedup=1.24x2024.0926.8
MIDASParameters=1B, d(i)/i (block size)=4, Schedule=PROP-1, Speedup=1.39x2024.0926.7
GRADSTACKParameters=2B, d(i)/i (block size)=8, Schedule=PROP-2, Speedup=1.24x2024.0925.9
MIDASParameters=1B, d(i)/i (block size)=3, Schedule=PROP-1, Speedup=1.41x2024.0925.6
BaselineParameters=1B, d(i)/i (block size)=24, Schedule=1x, Speedup=1x2024.0924
GRADSTACKParameters=1B, d(i)/i (block size)=4, Schedule=PROP-1, Speedup=1.39x2024.0922.6
GRADSTACKParameters=1B, d(i)/i (block size)=4, Schedule=PROP-2, Speedup=1.24x2024.0920.4