Language Modeling on WikiText-2 TinyLlama
0.0036ΔPPLTurboAngle
Evaluation results
| Method | Links | |
|---|---|---|
| TurboAnglen=128, Bits/elem=3.50, norms=fp322026.03 | 0.0036 | |
| TurboAnglen=48, Bits/elem=2.79, norms=fp322026.03 | 0.015 | |
| TurboAnglen=64, Bits/elem=3.00, norms=fp322026.03 | 0.0176 | |
| TurboAnglen=32, Bits/elem=2.50, norms=fp322026.03 | 0.0694 | |
| TQ-sym4-g4sym=4, g=4, Bits/elem=4.00, norms=fp322026.03 | 0.1295 | |
| TQ-sym3-g4sym=3, g=4, Bits/elem=3.00, norms=fp322026.03 | 0.7814 |