Scaling Law Parameter Estimation on Scaling Law Analysis Corpus
0.73Scaling Law Coeff. aKaplan et al.
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Kaplan et al.2022.03 | 0.73 | 0.27 | |
| Minimum over training curves (Approach 1)Estimation Technique=Bootstrapping (80% dataset, 100 samples)2022.03 | 0.5 | 0.5 | |
| IsoFLOP profiles (Approach 2)Estimation Technique=Bootstrapping (80% dataset, 100 samples)2022.03 | 0.49 | 0.51 | |
| Parametric modelling of the loss (Approach 3)Estimation Technique=Bootstrapping (80% dataset, 100 samples)2022.03 | 0.46 | 0.54 |