Hyper-parameter Search on Dense-8B
1.02FLOPsGrid Search
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Grid SearchStrategy=Grid Search, Proxy Models=9 × Dense-8B2026.06 | 1.02 | — | |
| Ours (Scaling)Strategy=Ours (Scaling), Proxy Models=9 × {100M, 500M}2026.06 | 8.15 | 92 |
| Method | Links | ||
|---|---|---|---|
| Grid SearchStrategy=Grid Search, Proxy Models=9 × Dense-8B2026.06 | 1.02 | — | |
| Ours (Scaling)Strategy=Ours (Scaling), Proxy Models=9 × {100M, 500M}2026.06 | 8.15 | 92 |