Activation Reconstruction on GPT2 Small
0.32MSEfmxcoder
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| fmxcoderVariant=fmxcoder (p = 0), masking_probability=02026.05 | 0.32 | 93.55 | 96.79 | 0.0258 | |
| fmxcoderVariant=fmxcoder (p = 0.05), masking_probability=0.052026.05 | 0.33 | 93.3 | 96.68 | 0.0185 | |
| SAEVariant=SAE2026.05 | 0.53 | 92.56 | 96.23 | 0.0084 | |
| CrosscoderVariant=Crosscoder2026.05 | 0.64 | 87.04 | 93.46 | 0.0116 |