Machine Unlearning on MUSE Books (ES Un., ROUGE Re., |Priv. Leak|)
92ES Un.Fully Fine-tuned
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Fully Fine-tunedBackbone=Llama-2-7b-hf2026.06 | 92 | 69 | 57.34 | |
| SimNPOBackbone=Llama-2-7b-hf2026.06 | 13.8 | 53.7 | 54.81 | |
| SimNPO w. SAGEBackbone=Llama-2-7b-hf2026.06 | 10.6 | 61.1 | 54.66 | |
| UNDIALBackbone=Llama-2-7b-hf2026.06 | 2.4 | 62.7 | 18.45 | |
| UNDIAL w. SAGEBackbone=Llama-2-7b-hf2026.06 | 2.4 | 70 | 18.05 | |
| VanillaBackbone=Llama-2-7b-hf2026.06 | 1 | 68 | 8.16 | |
| GradDiffBackbone=Llama-2-7b-hf2026.06 | 0.8 | 5.2 | 28.62 | |
| GradDiff w. SAGEBackbone=Llama-2-7b-hf2026.06 | 0.8 | 61 | 32.54 | |
| RMUBackbone=Llama-2-7b-hf2026.06 | 0.8 | 12.4 | 19.91 | |
| RMU w. SAGEBackbone=Llama-2-7b-hf2026.06 | 0.8 | 33.6 | 38.76 | |
| WGABackbone=Llama-2-7b-hf2026.06 | 0.8 | 48.6 | 43.82 | |
| WGA w. SAGEBackbone=Llama-2-7b-hf2026.06 | 0.8 | 61.9 | 25.55 | |
| PDUBackbone=Llama-2-7b-hf2026.06 | 0.8 | 4.2 | 54.48 | |
| PDU w. SAGEBackbone=Llama-2-7b-hf2026.06 | 0.8 | 60.5 | 71.21 |