Token Extrapolation on Pythia Predict 180.4B–307B
0.781Pooled R2Shannon (Ours, 9p)
Evaluation results
| Method | Links | |
|---|---|---|
| Shannon (Ours, 9p)Number of fitted constants=9p2026.05 | 0.781 | |
| Asymmetric Law2026.05 | 0.774 | |
| QiD Law2026.05 | 0.766 | |
| Symmetric Law2026.05 | 0.76 | |
| Shannon-Simpl (Ours, 6p)Number of fitted constants=6p2026.05 | 0.753 | |
| Law of Precision2026.05 | 0.632 | |
| Chinchilla2026.05 | 0.265 | |
| OpenAI2026.05 | 0.245 |