Language Modeling on WikiText-103 Phi-3.5-mini
6.292PPLfp16
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| fp16bits=16.002026.05 | 6.292 | 0 | |
| HQMQbits=3.79, configuration=s96_r42026.05 | 6.537 | 0.245 | |
| HQMQbits=3.54, configuration=s48_r42026.05 | 6.612 | 0.32 | |
| naive int4bits=4.002026.05 | 6.765 | 0.473 | |
| HQMQbits=3.04, configuration=s24_r32026.05 | 7.121 | 0.829 | |
| naive int3bits=3.002026.05 | 12.922 | 6.63 |