Commonsense Reasoning on HellaSwag (accuracy, retention)
59.9AccuracyTeacher FP16
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Teacher FP16Size=1.3B, Precision=FP16, Evaluation Protocol=Zero-shot2026.04 | 59.9 | — | |
| BitMamba-2Size=1B, Precision=1.58-bit, Evaluation Protocol=Zero-shot2026.04 | 45.6 | — | |
| DF-SSMSize=278 MB, Evaluation Protocol=Zero-shot2026.04 | 41.4 | 69.1 | |
| RandomEvaluation Protocol=Zero-shot2026.04 | 25 | — |