Unlearning on MUSE-News (test)
58.4VerbMem (w/o Q)Pre-unlearn
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Pre-unlearn2025.10 | 58.4 | 34.2 | 64 | 54.4 | 55.2 | 48.2 | 26.9 | 56.2 | 42.7 | |
| NPOoptimizer=ZO2025.10 | 21.3 | 17.3 | 39.2 | 26.3 | 41.2 | 29 | 23.5 | 50.7 | 36.8 | |
| GradDiffoptimizer=ZO2025.10 | 21.3 | 16.7 | 29.6 | 15.8 | 30.4 | 19.5 | 2.6 | 50.3 | 36.6 | |
| GradDiffoptimizer=Hybrid2025.10 | 9.2 | 19 | 25.7 | 40 | 29.2 | 33.8 | 23.3 | 52.2 | 35.9 | |
| NPOoptimizer=Hybrid2025.10 | 8.9 | 8.4 | 35.9 | 32 | 38.9 | 34 | 26.4 | 49.7 | 35.7 | |
| GradDiff2025.10 | 5.9 | 26.2 | 30.9 | 48.2 | 46 | 51.5 | 26.9 | 56.2 | 42.7 | |
| NPOoptimizer=RS2025.10 | 5 | 29.5 | 43.4 | 46.9 | 43.3 | 45.7 | 26.8 | 53 | 37 | |
| GradDiffoptimizer=signSGD2025.10 | 4.9 | 27.2 | 17.1 | 49.5 | 26.4 | 50.6 | 26.1 | 49 | 37.2 | |
| GradDiffoptimizer=RS2025.10 | 4.9 | 25.9 | 24.4 | 52.8 | 32.8 | 47.9 | 26.1 | 49.4 | 37.6 | |
| GradDiffoptimizer=SAM2025.10 | 4.9 | 28.3 | 43.9 | 51.3 | 31.4 | 47.6 | 26.8 | 46.2 | 37 | |
| GradDiffoptimizer=signAdam2025.10 | 3.6 | 11.8 | 27.3 | 43.1 | 35.8 | 36.1 | 25.2 | 49.3 | 36.4 | |
| NPOoptimizer=signSGD2025.10 | 2.7 | 29.4 | 43.5 | 47.5 | 37.4 | 46 | 26.4 | 51.9 | 37.9 | |
| NPO2025.10 | 0.9 | 34 | 48.2 | 50 | 43.4 | 47 | 26.6 | 52.4 | 37.5 | |
| NPOoptimizer=signAdam2025.10 | 0.7 | 14.4 | 45.6 | 35.3 | 42.3 | 41.4 | 28.9 | 53.9 | 40 | |
| NPOoptimizer=SAM2025.10 | 0 | 19.5 | 42 | 47.6 | 35.2 | 42 | 26.1 | 42.7 | 29.4 |