Accuracy Improvement on PIQA Reasoning
2.05Accuracy ImprovementAUTOMIXER-350M
Evaluation results
| Method | Links | |
|---|---|---|
| AUTOMIXER-350MNumber of Parameters=350M2025.06 | 2.05 | |
| AUTOMIXER-350MNumber of Parameters=1.5B2025.06 | 1.22 | |
| AUTOMIXER-350MNumber of Parameters=3B2025.06 | 1.06 | |
| N-GRAM SAMPLINGNumber of Parameters=350M2025.06 | 1.03 | |
| PPL SAMPLINGNumber of Parameters=350M2025.06 | 0.7 | |
| N-GRAM SAMPLINGNumber of Parameters=1.5B2025.06 | 0.58 | |
| N-GRAM SAMPLINGNumber of Parameters=3B2025.06 | 0.54 | |
| PPL SAMPLINGNumber of Parameters=3B2025.06 | 0.42 | |
| PPL SAMPLINGNumber of Parameters=1.5B2025.06 | 0.4 | |
| AUTOMIXER-75MNumber of Parameters=350M2025.06 | 0.01 | |
| AUTOMIXER-75MNumber of Parameters=3B2025.06 | 0 | |
| AUTOMIXER-75MNumber of Parameters=1.5B2025.06 | -0.02 |