Machine Unlearning on TOFU Llama-3.2-1B (Split99)
91.9Forget QualityNPO
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| NPOSetting=CLEAN, Backbone=Llama-3.2-1B2026.02 | 91.9 | 62.4 | 59.9 | 30.6 | |
| NPOSetting=MPU, m=2, kappa=0.01, Backbone=Llama-3.2-1B2026.02 | 91.9 | 62.8 | 59.7 | 28.2 | |
| NPOSetting=NOISED, Backbone=Llama-3.2-1B2026.02 | 76.6 | 64 | 60 | 32.9 | |
| GRADDIFFSetting=CLEAN, Backbone=Llama-3.2-1B2026.02 | 40.5 | 53.5 | 46.1 | 77.1 | |
| GRADDIFFSetting=MPU, m=2, kappa=0.01, Backbone=Llama-3.2-1B2026.02 | 40.5 | 54.7 | 46.4 | 77.2 | |
| GRADDIFFSetting=NOISED, Backbone=Llama-3.2-1B2026.02 | 26.6 | 53.3 | 46.1 | 73.3 | |
| DPOSetting=MPU, m=2, kappa=0.01, Backbone=Llama-3.2-1B2026.02 | 26.6 | 64.1 | 59.1 | -28.9 | |
| DPOSetting=CLEAN, Backbone=Llama-3.2-1B2026.02 | 16.5 | 63.7 | 59.1 | -25.5 | |
| DPOSetting=NOISED, Backbone=Llama-3.2-1B2026.02 | 16.5 | 62 | 59.5 | -19.8 | |
| SIMNPOSetting=MPU, m=2, kappa=0.01, Backbone=Llama-3.2-1B2026.02 | 9.71 | 52.5 | 59.8 | -71.8 | |
| GRADASCENTSetting=MPU, m=2, kappa=0.01, Backbone=Llama-3.2-1B2026.02 | 5.41 | 46.8 | 0.0231 | 69.6 | |
| SIMNPOSetting=CLEAN, Backbone=Llama-3.2-1B2026.02 | 5.41 | 52.6 | 59.8 | -68.4 | |
| SIMNPOSetting=NOISED, Backbone=Llama-3.2-1B2026.02 | 5.41 | 52.2 | 59.2 | -70.2 | |
| UNDIALSetting=CLEAN, Backbone=Llama-3.2-1B2026.02 | 1.43 | 53 | 61.3 | -76.4 | |
| UNDIALSetting=NOISED, Backbone=Llama-3.2-1B2026.02 | 1.43 | 52.7 | 61.4 | -77.4 | |
| UNDIALSetting=MPU, m=2, kappa=0.01, Backbone=Llama-3.2-1B2026.02 | 1.43 | 52.9 | 61.5 | -78 | |
| SATIMPSetting=NOISED, Backbone=Llama-3.2-1B2026.02 | 0.676 | 47 | 59.7 | -99.1 | |
| SATIMPSetting=MPU, m=2, kappa=0.01, Backbone=Llama-3.2-1B2026.02 | 0.676 | 47.6 | 60.1 | -98.9 | |
| SATIMPSetting=CLEAN, Backbone=Llama-3.2-1B2026.02 | 0.302 | 47.4 | 60 | -98.9 | |
| GRADASCENTSetting=CLEAN, Backbone=Llama-3.2-1B2026.02 | 0.0066 | 35.5 | 0 | 65.8 | |
| GRADASCENTSetting=NOISED, Backbone=Llama-3.2-1B2026.02 | 0 | 24.6 | 0 | 58.9 |