Reading Comprehension on BoolQ (Score Metric)
69.7ScoreQwen3-0.6B
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3-0.6B2026.03 | 69.7 | |
| BaselineBase Model=Llama 3.2 1B Instruct2026.03 | 69 | |
| SVDSoftmaxBase Model=Llama 3.2 1B Instruct2026.03 | 69 | |
| FlashHeadBase Model=Llama 3.2 1B Instruct2026.03 | 69 | |
| Vocab. TrimmingBase Model=Llama 3.2 1B Instruct2026.03 | 65 | |
| PolychromaticLMstage=Base2026.03 | 61.13 | |
| AverisModel=Qwen3-0.6B, Precision=FP4 (W4A4G4), Training Tokens=10B, Stochastic Rounding=True2026.03 | 57.46 | |
| PolychromaticLMstage=SFT2026.03 | 55.63 | |
| BF16Model=Qwen3-0.6B, Precision=BF16, Training Tokens=10B2026.03 | 53.09 | |
| Random2026.03 | 50 |