Language Modeling on Qwen 3B 2.5
24.6∆PPL (%)RTN W4A16 g128
Evaluation results
| Method | Links | |
|---|---|---|
| RTN W4A16 g128bpw=4.12026.05 | 24.6 | |
| QAM-W-polarbpw=4.02026.05 | 19.6 | |
| AWQ W4A16 g128bpw=4.12026.05 | 6.3 | |
| AutoRound W4A16 g128bpw=4.12026.05 | 5.8 | |
| QAM-W-4bpw=4.02026.05 | 5 | |
| GPTQ W4A16 g128bpw=4.12026.05 | 2.9 | |
| QAM-W-5.5bpw=5.52026.05 | 0.3 | |
| SmoothQuant W8A8bpw=8.12026.05 | 0.2 |