Language Modeling on Qwen 3.5 (val)
8.89Perplexity (PPL)FLA
Evaluation Results
| Method | Links | |
|---|---|---|
| FLAMODEL=4B, Precision=FP2026.06 | 8.89 | |
| FLAMODEL=4B, Precision=W4A162026.06 | 9.66 | |
| Multiplication-Only Matrix Inversion ApproximationMODEL=4B, Precision=W4A162026.06 | 9.67 | |
| FLAMODEL=0.8B, Precision=FP2026.06 | 15.74 | |
| FLAMODEL=0.8B, Precision=W4A162026.06 | 17.54 | |
| Multiplication-Only Matrix Inversion ApproximationMODEL=0.8B, Precision=W4A162026.06 | 17.55 |