Token Extrapolation on Pythia Predict 272.6B–307B
0.945Pooled R2Shannon-Simpl (Ours, 6p)
Evaluation results
| Method | Links | |
|---|---|---|
| Shannon-Simpl (Ours, 6p)Number of fitted constants=6p2026.05 | 0.945 | |
| Shannon (Ours, 9p)Number of fitted constants=9p2026.05 | 0.941 | |
| QiD Law2026.05 | 0.862 | |
| Symmetric Law2026.05 | 0.86 | |
| Asymmetric Law2026.05 | 0.851 | |
| Law of Precision2026.05 | 0.743 | |
| Chinchilla2026.05 | 0.352 | |
| OpenAI2026.05 | 0.297 |