List your company
ResearchFormerly WizWand

Reasoning Accuracy Improvement on Winogrande

2.14Accuracy ImprovementAUTOMIXER-350M
-0.13760.45371.0451.6363Jun 27, 2025
Updated 8mo ago

Evaluation results

MethodLinks
AUTOMIXER-350MNumber of Parameters=350M2025.062.14
AUTOMIXER-350MNumber of Parameters=1.5B2025.061.41
AUTOMIXER-350MNumber of Parameters=3B2025.061.18
PPL SAMPLINGNumber of Parameters=350M2025.060.9
N-GRAM SAMPLINGNumber of Parameters=1.5B2025.060.9
N-GRAM SAMPLINGNumber of Parameters=350M2025.060.85
N-GRAM SAMPLINGNumber of Parameters=3B2025.060.84
PPL SAMPLINGNumber of Parameters=1.5B2025.060.68
PPL SAMPLINGNumber of Parameters=3B2025.060.15
AUTOMIXER-75MNumber of Parameters=3B2025.060.02
AUTOMIXER-75MNumber of Parameters=1.5B2025.06-0.03
AUTOMIXER-75MNumber of Parameters=350M2025.06-0.05