Commonsense Reasoning on PIQA (accuracy, retention)
73.2AccuracyTeacher FP16
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Teacher FP16Size=1.3B, Precision=FP16, Evaluation Protocol=Zero-shot2026.04 | 73.2 | — | |
| BitMamba-2Size=1B, Precision=1.58-bit, Evaluation Protocol=Zero-shot2026.04 | 68.8 | — | |
| DF-SSMSize=278 MB, Evaluation Protocol=Zero-shot2026.04 | 67.1 | 91.7 | |
| RandomEvaluation Protocol=Zero-shot2026.04 | 50 | — |