Language Modeling on GPT-2 style (val)
0.9766BPBGEAR-EVOLVE
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GEAR-EVOLVEVRAM (GB)=33.5, Params (M)=85.92026.05 | 0.9766 | 40 | |
| GEAR-FIXEDVRAM (GB)=66.2, Params (M)=85.92026.05 | 0.9791 | 84 | |
| GEAR-PROMPTVRAM (GB)=63.6, Params (M)=71.32026.05 | 0.98 | 72 | |
| Baseline (AutoResearch)VRAM (GB)=60.2, Params (M)=80.92026.05 | 0.9823 | — |