Machine Unlearning on MUSE Books (Specific VerbMem/KnowMem/Retain Variants)
99.8VerbMem (No Q)Pre-unlearn
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Pre-unlearn2025.10 | 99.8 | 85.3 | 59.4 | 36.8 | 66.9 | 50.5 | |
| NPO w/ ZOAlgorithm=NPO, Optimizer=ZO2025.10 | 20.7 | 16.2 | 23.9 | 16.4 | 36.6 | 21.1 | |
| GradDiff w/ ZOAlgorithm=GradDiff, Optimizer=ZO2025.10 | 12.3 | 11.5 | 9.2 | 4 | 26.8 | 11 | |
| NPOAlgorithm=NPO2025.10 | 0 | 48.5 | 0 | 34.8 | 53.65 | 51 | |
| NPO w/ signSGDAlgorithm=NPO, Optimizer=signSGD2025.10 | 0 | 15.6 | 0 | 20.6 | 44.5 | 42 | |
| NPO w/ signAdamAlgorithm=NPO, Optimizer=signAdam2025.10 | 0 | 30.7 | 0 | 25.8 | 35.9 | 52.5 | |
| NPO w/ RSAlgorithm=NPO, Optimizer=RS2025.10 | 0 | 34.5 | 0 | 23.4 | 54.6 | 49.9 | |
| NPO w/ SAMAlgorithm=NPO, Optimizer=SAM2025.10 | 0 | 30 | 0 | 22.5 | 35.2 | 46 | |
| NPO w/ HybridAlgorithm=NPO, Optimizer=Hybrid2025.10 | 0 | 0 | 0 | 0 | 54.8 | 38.5 | |
| GradDiffAlgorithm=GradDiff2025.10 | 0 | 60.5 | 5.9 | 31.6 | 46 | 51 | |
| GradDiff w/ signSGDAlgorithm=GradDiff, Optimizer=signSGD2025.10 | 0 | 36.5 | 2.81 | 29.2 | 36.7 | 49.7 | |
| GradDiff w/ signAdamAlgorithm=GradDiff, Optimizer=signAdam2025.10 | 0 | 23.9 | 0.5 | 26.1 | 25.3 | 51.2 | |
| GradDiff w/ RSAlgorithm=GradDiff, Optimizer=RS2025.10 | 0 | 0.61 | 0 | 27.35 | 26.8 | 47.9 | |
| GradDiff w/ SAMAlgorithm=GradDiff, Optimizer=SAM2025.10 | 0 | 13.4 | 0 | 30.4 | 44.5 | 50 | |
| GradDiff w/ HybridAlgorithm=GradDiff, Optimizer=Hybrid2025.10 | 0 | 0 | 0 | 0 | 48.5 | 38.2 |