Pre-training on C4 (Resource Tracking)
4.86Evaluation Loss (10k Steps)GrassJump
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| GrassJumpArchitecture=LLaMA-7B2025.10 | 4.86 | 9.24 | 3.34 | 91.6 | 48.7 | |
| SubTrack++Architecture=LLaMA-7B2025.10 | 4.94 | 9.57 | 3.36 | 93.2 | 50.3 | |
| GrassWalkArchitecture=LLaMA-7B2025.10 | 4.94 | 9.55 | 3.37 | 93.2 | 50.3 |