Reasoning Accuracy Improvement on Winogrande
2.14Accuracy ImprovementAUTOMIXER-350M
Evaluation Results
| Method | Links | |
|---|---|---|
| AUTOMIXER-350MNumber of Parameters=350M2025.06 | 2.14 | |
| AUTOMIXER-350MNumber of Parameters=1.5B2025.06 | 1.41 | |
| AUTOMIXER-350MNumber of Parameters=3B2025.06 | 1.18 | |
| PPL SAMPLINGNumber of Parameters=350M2025.06 | 0.9 | |
| N-GRAM SAMPLINGNumber of Parameters=1.5B2025.06 | 0.9 | |
| N-GRAM SAMPLINGNumber of Parameters=350M2025.06 | 0.85 | |
| N-GRAM SAMPLINGNumber of Parameters=3B2025.06 | 0.84 | |
| PPL SAMPLINGNumber of Parameters=1.5B2025.06 | 0.68 | |
| PPL SAMPLINGNumber of Parameters=3B2025.06 | 0.15 | |
| AUTOMIXER-75MNumber of Parameters=3B2025.06 | 0.02 | |
| AUTOMIXER-75MNumber of Parameters=1.5B2025.06 | -0.03 | |
| AUTOMIXER-75MNumber of Parameters=350M2025.06 | -0.05 |