Reasoning on SIQA (Accuracy Improvement)
2.12Accuracy ImprovementAUTOMIXER-350M
Evaluation Results
| Method | Links | |
|---|---|---|
| AUTOMIXER-350MNumber of Parameters=350M2025.06 | 2.12 | |
| AUTOMIXER-350MNumber of Parameters=1.5B2025.06 | 1.38 | |
| AUTOMIXER-350MNumber of Parameters=3B2025.06 | 1.14 | |
| N-GRAM SAMPLINGNumber of Parameters=350M2025.06 | 1.09 | |
| N-GRAM SAMPLINGNumber of Parameters=3B2025.06 | 0.64 | |
| N-GRAM SAMPLINGNumber of Parameters=1.5B2025.06 | 0.45 | |
| PPL SAMPLINGNumber of Parameters=3B2025.06 | 0.27 | |
| PPL SAMPLINGNumber of Parameters=1.5B2025.06 | 0.07 | |
| AUTOMIXER-75MNumber of Parameters=3B2025.06 | -0.02 | |
| AUTOMIXER-75MNumber of Parameters=1.5B2025.06 | -0.05 | |
| PPL SAMPLINGNumber of Parameters=350M2025.06 | -0.1 | |
| AUTOMIXER-75MNumber of Parameters=350M2025.06 | -0.1 |