Induction on Induction Task
16Top-1 Accuracy (Baseline)top-6 spectral picks (incl 3 induction heads)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| top-6 spectral picks (incl 3 induction heads)Model=Karpathy 124M2026.05 | 16 | 0.85 | -95 | |
| mech-interp-classified L8H2 + L5H0Model=Pythia 160M2026.05 | 4.7 | 0.05 | -99 | |
| top-6 spectral picks (mostly self/prev)Model=Pythia 410M2026.05 | 3.7 | 2.1 | -43 | |
| mech-interp-classified + 2nd-class inductionModel=Pythia 410M2026.05 | 3.7 | 0.85 | -77 | |
| all heads with induction sel ≥ 50× (11 heads)Model=Pythia 410M2026.05 | 3.7 | 0 | -100 |