Language Modeling on WikiText-2 Mistral-7B
0.001ΔPPLTurboAngle
Evaluation Results
| Method | Links | |
|---|---|---|
| TurboAnglen=64, Bits/elem=3.00, norms=fp322026.03 | 0.001 | |
| TurboAnglen=128, Bits/elem=3.50, norms=fp322026.03 | 0.003 | |
| TurboAnglen=48, Bits/elem=2.79, norms=fp322026.03 | 0.0034 | |
| TurboAnglen=32, Bits/elem=2.50, norms=fp322026.03 | 0.0104 | |
| TQ-sym4-g4sym=4, g=4, Bits/elem=4.00, norms=fp322026.03 | 0.0148 | |
| TQ-sym3-g4sym=3, g=4, Bits/elem=3.00, norms=fp322026.03 | 0.1224 |