Commonsense Reasoning on HellaSwag 5-shot
69.4AccuracyMoE 128e8a1s
Evaluation results
| Method | Links | |
|---|---|---|
| MoE 128e8a1sModel=MoE 128e8a1s, Training Steps=100k2026.05 | 69.4 | |
| MoE 128e8a4g1sModel=MoE 128e8a4g1s, Training Steps=100k2026.05 | 69.3 | |
| DenseModel=Dense, Training Steps=100k2026.05 | 56.5 |