Scaling Law Fitting on LLM-book (test)
3.671Mean Relative Error (MRE)PBH
Evaluation Results
| Method | Links | |
|---|---|---|
| PBHN=5, Dimension (d)=19, LBFGS steps=5, CPU time=300s, Gamma=10, Delta=10^-3, Seeds=32026.05 | 3.671 | |
| PBHN=15, Dimension (d)=19, LBFGS steps=5, CPU time=300s, Gamma=10, Delta=10^-3, Seeds=32026.05 | 3.752 | |
| PBHN=10, Dimension (d)=19, LBFGS steps=5, CPU time=300s, Gamma=10, Delta=10^-3, Seeds=32026.05 | 4.136 | |
| BHDimension (d)=19, LBFGS steps=5, CPU time=300s, Gamma=10, Delta=10^-3, Seeds=32026.05 | 4.915 | |
| ZOPN=5, Dimension (d)=19, LBFGS steps=5, CPU time=300s, Gamma=10, Delta=10^-3, Seeds=32026.05 | 6.158 | |
| PBHN=5, d=47, lbfgs steps=52026.05 | 9.91 | |
| PBHN=5, lbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 10.046 | |
| PBHN=15, lbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 10.173 | |
| PBHN=50, d=47, lbfgs steps=52026.05 | 10.256 | |
| PBHN=40, lbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 10.264 | |
| PBHN=50, lbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 10.265 | |
| PBHN=40, d=47, lbfgs steps=52026.05 | 10.295 | |
| PBHN=30, d=47, lbfgs steps=52026.05 | 10.451 | |
| PBHN=15, d=47, lbfgs steps=52026.05 | 10.529 | |
| PBHN=20, d=47, lbfgs steps=52026.05 | 10.59 | |
| BHd=47, lbfgs steps=52026.05 | 10.629 | |
| BHlbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 10.649 | |
| PBHN=30, lbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 10.718 | |
| PBHN=20, lbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 10.722 | |
| ZOPd=47, lbfgs steps=52026.05 | 10.8 | |
| ZOPlbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 10.8 | |
| PBHN=10, d=47, lbfgs steps=52026.05 | 10.947 | |
| PBHN=10, lbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 10.949 |