Scaling Law Fitting on LLM-github (test)
8.597MREPBH
Evaluation Results
| Method | Links | |
|---|---|---|
| PBHN=5, Dimension (d)=19, LBFGS steps=5, CPU time=300s, Gamma=10, Delta=10^-3, Seeds=32026.05 | 8.597 | |
| PBHN=15, Dimension (d)=19, LBFGS steps=5, CPU time=300s, Gamma=10, Delta=10^-3, Seeds=32026.05 | 8.961 | |
| PBHN=10, Dimension (d)=19, LBFGS steps=5, CPU time=300s, Gamma=10, Delta=10^-3, Seeds=32026.05 | 9.899 | |
| ZOPN=5, Dimension (d)=19, LBFGS steps=5, CPU time=300s, Gamma=10, Delta=10^-3, Seeds=32026.05 | 11.131 | |
| BHDimension (d)=19, LBFGS steps=5, CPU time=300s, Gamma=10, Delta=10^-3, Seeds=32026.05 | 13.191 | |
| PBHN=5, d=47, lbfgs steps=52026.05 | 16.579 | |
| PBHN=20, d=47, lbfgs steps=52026.05 | 16.835 | |
| PBHN=20, lbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 17.305 | |
| PBHN=5, lbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 17.323 | |
| PBHN=10, lbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 17.385 | |
| PBHN=40, lbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 17.899 | |
| BHd=47, lbfgs steps=52026.05 | 18.243 | |
| PBHN=15, lbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 18.258 | |
| PBHN=10, d=47, lbfgs steps=52026.05 | 18.328 | |
| PBHN=50, d=47, lbfgs steps=52026.05 | 18.329 | |
| PBHN=30, lbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 18.434 | |
| PBHN=50, lbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 18.47 | |
| PBHN=30, d=47, lbfgs steps=52026.05 | 18.686 | |
| PBHN=40, d=47, lbfgs steps=52026.05 | 18.75 | |
| BHlbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 18.847 | |
| PBHN=15, d=47, lbfgs steps=52026.05 | 18.947 | |
| ZOPd=47, lbfgs steps=52026.05 | 19.882 | |
| ZOPlbfgs steps=10, CPU time=300s, d=47, seeds=32026.05 | 19.882 |