Neural Collapse trajectory analysis on WikiText-103
0.97Descent Rate (r)SAE on Pythia L6
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SAE on Pythia L6K=2048, L1=soft-L1, n=92026.05 | 0.97 | — |
Loading the SOTA2 catalog…
| Method | Links | ||
|---|---|---|---|
| SAE on Pythia L6K=2048, L1=soft-L1, n=92026.05 | 0.97 | — |