Question Answering on OpenBookQA (Accuracy Improvement)
2.01Accuracy ImprovementAUTOMIXER-350M
Evaluation Results
| Method | Links | |
|---|---|---|
| AUTOMIXER-350MNumber of Parameters=350M2025.06 | 2.01 | |
| AUTOMIXER-350MNumber of Parameters=1.5B2025.06 | 1.33 | |
| AUTOMIXER-350MNumber of Parameters=3B2025.06 | 1.23 | |
| N-GRAM SAMPLINGNumber of Parameters=350M2025.06 | 1.16 | |
| N-GRAM SAMPLINGNumber of Parameters=3B2025.06 | 0.95 | |
| PPL SAMPLINGNumber of Parameters=1.5B2025.06 | 0.75 | |
| N-GRAM SAMPLINGNumber of Parameters=1.5B2025.06 | 0.54 | |
| PPL SAMPLINGNumber of Parameters=3B2025.06 | 0.5 | |
| PPL SAMPLINGNumber of Parameters=350M2025.06 | 0.4 | |
| AUTOMIXER-75MNumber of Parameters=1.5B2025.06 | 0.01 | |
| AUTOMIXER-75MNumber of Parameters=350M2025.06 | -0.03 | |
| AUTOMIXER-75MNumber of Parameters=3B2025.06 | -0.04 |