Machine Unlearning on MUSE News (ES Un., ROUGE Re., |Priv. Leak|)
0.011ES UnlearningWGA w. SAGE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| WGA w. SAGEBackbone=Llama-2-7b-hf2026.06 | 0.011 | 46.8 | 102.6 | |
| WGABackbone=Llama-2-7b-hf2026.06 | 0.012 | 43.6 | 103.7 | |
| UNDIALBackbone=Llama-2-7b-hf2026.06 | 0.013 | 18.9 | 99.45 | |
| UNDIAL w. SAGEBackbone=Llama-2-7b-hf2026.06 | 0.013 | 26.4 | 89.86 | |
| RMU w. SAGEBackbone=Llama-2-7b-hf2026.06 | 0.019 | 49.6 | 30.9 | |
| VanillaBackbone=Llama-2-7b-hf2026.06 | 0.02 | 56 | 4.72 | |
| RMUBackbone=Llama-2-7b-hf2026.06 | 0.021 | 48.2 | 25.59 | |
| GradDiff w. SAGEBackbone=Llama-2-7b-hf2026.06 | 0.07 | 49.6 | 97.08 | |
| GradDiffBackbone=Llama-2-7b-hf2026.06 | 0.071 | 48.7 | 98.68 | |
| PDU w. SAGEBackbone=Llama-2-7b-hf2026.06 | 0.141 | 48.4 | 99.81 | |
| PDUBackbone=Llama-2-7b-hf2026.06 | 0.146 | 50.1 | 99.79 | |
| SimNPO w. SAGEBackbone=Llama-2-7b-hf2026.06 | 0.212 | 53.2 | 99.87 | |
| SimNPOBackbone=Llama-2-7b-hf2026.06 | 0.214 | 48.6 | 99.87 | |
| Fully Fine-tunedBackbone=Llama-2-7b-hf2026.06 | 0.29 | 55 | 99.81 |