Question Answering on BoolQ (Accuracy and Retention)
64.2AccuracyTeacher FP16
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Teacher FP16Size=1.3B, Precision=FP16, Evaluation Protocol=Zero-shot2026.04 | 64.2 | — | |
| BitMamba-2Size=1B, Precision=1.58-bit, Evaluation Protocol=Zero-shot2026.04 | 62.4 | — | |
| DF-SSMSize=278 MB, Evaluation Protocol=Zero-shot2026.04 | 60.8 | 94.7 | |
| RandomEvaluation Protocol=Zero-shot2026.04 | 50 | — |