Machine Unlearning on MUSE-News Llama 2 7B
-99.8951Privacy LeakageSimNPO
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| SimNPO2026.01 | -99.8951 | — | — | — | 41.21 | 58.06 | 38.29 | |
| Original2026.01 | -99.8111 | — | — | — | 55.52 | 64.43 | 57.89 | |
| Target2025.05 | -99.81 | 56.64 | 63.3 | 54.98 | — | — | — | |
| Unilogit+KLlr=5e-62025.05 | -99.79 | 51.61 | 59.72 | 53.44 | — | — | — | |
| Unilogit+KLlr=8e-62025.05 | -99.77 | 43.01 | 57.61 | 53.08 | — | — | — | |
| Unilogit+KLlr=8.5e-62025.05 | -99.77 | 41.38 | 57.1 | 52.87 | — | — | — | |
| GA+KLlr=1e-52025.05 | -99.75 | 41.22 | 56.51 | 51.77 | — | — | — | |
| RKLD+KLlr=1e-52025.05 | -99.75 | 47.96 | 55.02 | 50.44 | — | — | — | |
| ME+GDlr=5e-62025.05 | -99.75 | 40.23 | 54.37 | 49.95 | — | — | — | |
| Undial+KLlr=1e-5, gamma=22025.05 | -99.75 | 42.37 | 58.27 | 52.62 | — | — | — | |
| Undial+KLlr=1e-5, gamma=42025.05 | -99.75 | 41.52 | 59.07 | 53.01 | — | — | — | |
| Undial+KLlr=1e-5, gamma=82025.05 | -99.75 | 40.81 | 55.97 | 48.6 | — | — | — | |
| Unilogit+KLlr=1e-5, entry=12025.05 | -99.75 | 39.35 | 52.44 | 50.88 | — | — | — | |
| Unilogit+KLlr=8.75e-62025.05 | -99.75 | 39.54 | 54.25 | 51.98 | — | — | — | |
| Unilogit+KLlr=1e-5, entry=22025.05 | -99.71 | 33.6 | 52.46 | 48.15 | — | — | — | |
| PDU2026.01 | -99.6641 | — | — | — | 39.68 | 44.84 | 21.37 | |
| Undial+KLlr=1e-4, gamma=22025.05 | -98.11 | 22.63 | 25.88 | 30.78 | — | — | — | |
| NPO+KLlr=5e-6, beta=0.1, entry=12025.05 | -98.09 | 47.7 | 58.09 | 53.04 | — | — | — | |
| NPO+KLlr=5e-6, beta=0.1, entry=22025.05 | -98.09 | 47.01 | 57.58 | 51.2 | — | — | — | |
| Undial+KLlr=1e-4, gamma=42025.05 | -96.94 | 21.15 | 18.69 | 26.47 | — | — | — | |
| NPO+KLlr=1e-5, beta=0.12025.05 | -93.76 | 40.71 | 59.44 | 50.55 | — | — | — | |
| NPO2026.01 | -90.848 | — | — | — | 45.52 | 59.78 | 42.55 | |
| TPO2026.01 | -73.6356 | — | — | — | 50.26 | 58.85 | 41.97 | |
| PALU2026.01 | -45.9068 | — | — | — | 46.52 | 44.42 | 27 | |
| Retain2026.01 | -4.72 | — | — | — | 56.02 | 32.79 | 20.16 | |
| Retain2025.05 | 0 | 20.3 | 33.93 | 52.34 | — | — | — | |
| NPOlr=1e-52025.05 | 57.4 | 7.24 | 7.24 | 7.74 | — | — | — |