Machine Unlearning on MUSE-Books Harry Potter
48.4R-forgetMistral-7B (base)
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Mistral-7B (base)Model=Mistral-7B-Instruct-v0.32026.01 | 48.4 | 50.4 | 89.71 | 59.74 | 0 | |
| Qwen2.5 (base)Model Architecture=Qwen2.5-3B-Instruct, Status=Base Model2026.01 | 30.04 | 31.89 | 73.39 | 65.48 | 0 | |
| DUETModel=Mistral-7B-Instruct-v0.32026.01 | 19.57 | 24.58 | 73.88 | 58.9 | 37.98 | |
| Semi-NPOModel=Mistral-7B-Instruct-v0.32026.01 | 15.75 | 18.892 | 48.02 | 22.95 | -14.32 | |
| DUETModel Architecture=Qwen2.5-3B-Instruct2026.01 | 14.15 | 16.72 | 70.01 | 65.29 | 27.49 | |
| Semi-NPOModel Architecture=Qwen2.5-3B-Instruct2026.01 | 12.78 | 17.13 | 24.64 | 65.53 | -16.68 | |
| FLATModel Architecture=Qwen2.5-3B-Instruct2026.01 | 9.05 | 16.44 | 24.68 | 65.2 | -12.55 | |
| FLATModel=Mistral-7B-Instruct-v0.32026.01 | 1.15 | 0.45 | 0 | 24.28 | -27.97 |