Linear Datamodeling on BrainRot (2K pool)
0.204LDSRISE
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| RISEModel=Pythia-1B, Subsets=128 random 50% training subsets, Fine-tuning seeds=32026.04 | 0.204 | 0.188 | |
| TrackStar full-modelModel=Pythia-1B, Subsets=128 random 50% training subsets, Fine-tuning seeds=32026.04 | 0.178 | 0.161 | |
| Final hidden-state cosineModel=Pythia-1B, Subsets=128 random 50% training subsets, Fine-tuning seeds=32026.04 | 0.146 | 0.132 | |
| TrackStar LM-headModel=Pythia-1B, Subsets=128 random 50% training subsets, Fine-tuning seeds=32026.04 | 0.053 | 0.035 | |
| RandomModel=Pythia-1B, Subsets=128 random 50% training subsets, Fine-tuning seeds=32026.04 | 0.011 | -0.008 |