Scaling law fitting on Baseline Scaling Dataset 400M (Held-out)
0.006RMSESoftQ
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SoftQk=52026.06 | 0.006 | 0.0047 | |
| Quantak=42026.06 | 0.015 | 0.0121 | |
| Chinchillak=52026.06 | 0.0311 | 0.0254 | |
| Muennighoffk=72026.06 | 0.0325 | 0.0271 |
Loading the SOTA2 catalog…