Scaling Law Fitting on LLM-c4 (test)
0.0411MREPBH
Evaluation Results
| Method | Links | |
|---|---|---|
| PBHN=5, Dimension (d)=19, LBFGS steps=5, CPU time=300s, Gamma=10, Delta=10^-3, Seeds=32026.05 | 0.0411 | |
| PBHN=15, Dimension (d)=19, LBFGS steps=5, CPU time=300s, Gamma=10, Delta=10^-3, Seeds=32026.05 | 0.0417 | |
| PBHN=10, Dimension (d)=19, LBFGS steps=5, CPU time=300s, Gamma=10, Delta=10^-3, Seeds=32026.05 | 0.0453 | |
| BHDimension (d)=19, LBFGS steps=5, CPU time=300s, Gamma=10, Delta=10^-3, Seeds=32026.05 | 0.0698 | |
| ZOPN=5, Dimension (d)=19, LBFGS steps=5, CPU time=300s, Gamma=10, Delta=10^-3, Seeds=32026.05 | 0.0706 | |
| PBHN=50, lbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 10.716 | |
| PBHN=15, lbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 10.874 | |
| PBHN=20, lbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 10.936 | |
| PBHN=5, lbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 10.937 | |
| PBHN=10, lbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 10.949 | |
| PBHN=50, d=47, lbfgs steps=52026.05 | 10.992 | |
| BHd=47, lbfgs steps=52026.05 | 11.06 | |
| PBHN=30, lbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 11.115 | |
| PBHN=20, d=47, lbfgs steps=52026.05 | 11.161 | |
| PBHN=30, d=47, lbfgs steps=52026.05 | 11.201 | |
| PBHN=40, d=47, lbfgs steps=52026.05 | 11.203 | |
| PBHN=5, d=47, lbfgs steps=52026.05 | 11.226 | |
| PBHN=10, d=47, lbfgs steps=52026.05 | 11.266 | |
| ZOPd=47, lbfgs steps=52026.05 | 11.309 | |
| ZOPlbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 11.309 | |
| BHlbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 11.314 | |
| PBHN=40, lbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 11.472 | |
| PBHN=15, d=47, lbfgs steps=52026.05 | 11.571 |