Language Modeling on Masked BERT encoding (test)
56.98Accuracy (dep)Vanilla
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| VanillaIntervention Type=None2025.06 | 56.98 | 56.98 | 56.98 | — | — | — | |
| Random MPIntervention Type=Random removal baseline, Base Method=Mean Projection2025.06 | 56.7 | 56.69 | 56.87 | 0.03 | 0.04 | 0.01 | |
| Random LEACEIntervention Type=Random removal baseline, Base Method=LEACE2025.06 | 56.54 | 56.58 | 56.74 | 0.03 | 0.04 | 0.01 | |
| Amnesic LEACEIntervention Type=Amnesic Probing, Base Method=LEACE2025.06 | 48.2 | 37.6 | 50.44 | 0.74 | 1.37 | 0.5 | |
| Amnesic MPIntervention Type=Amnesic Probing, Base Method=Mean Projection2025.06 | 44.61 | 34.2 | 48.56 | 1.45 | 2.09 | 0.86 | |
| Amnesic INLPIntervention Type=Amnesic Probing, Base Method=INLP2025.06 | 16.96 | 13.94 | 33.29 | 5.75 | 6.08 | 3.1 | |
| Random INLPIntervention Type=Random removal baseline, Base Method=INLP2025.06 | 9.24 | 4.67 | 54.29 | 7.06 | 7.77 | 0.49 |