Machine Unlearning on RWKU (Fidelity, Membership, and Knowledge Retention Metrics)
48.8Fidelity L1Base
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| BaseBackbone=LLaDA-8B-Instruct2026.05 | 48.8 | 43.3 | 46.9 | 55.1 | 37.2 | 39.5 | 33 | 36.7 | |
| BaseBackbone=Dream-7B-Instruct2026.05 | 41.8 | 43.8 | 45.7 | 50.4 | 35.6 | 75 | 27.3 | 37.1 | |
| DPOBackbone=Dream-7B-Instruct2026.05 | 30.8 | 38.6 | 43.3 | 47.1 | 30.8 | 64.2 | 26 | 38 | |
| GABackbone=Dream-7B-Instruct2026.05 | 29 | 18.8 | 36.8 | 42 | 25.7 | 61.7 | 27.7 | 40.4 | |
| SimNPOBackbone=Dream-7B-Instruct2026.05 | 27.6 | 22.7 | 36.3 | 36.9 | 24.4 | 68.5 | 29.5 | 39.2 | |
| MDUBackbone=Dream-7B-Instruct, tau (τ)=1.002026.05 | 26.2 | 24.5 | 30.5 | 47.5 | 31.8 | 69.2 | 26.7 | 39.5 | |
| MDUBackbone=Dream-7B-Instruct, tau (τ)=0.752026.05 | 23.8 | 22.5 | 28.8 | 44.8 | 29.5 | 62.5 | 25 | 35.8 | |
| WGABackbone=Dream-7B-Instruct2026.05 | 21.7 | 20.9 | 25.3 | 36.7 | 20.2 | 23.6 | 32 | 34.3 | |
| MDUBackbone=Dream-7B-Instruct, tau (τ)=0.502026.05 | 21.5 | 17.1 | 23.2 | 46.2 | 30.5 | 66.2 | 26.1 | 40.2 | |
| NPOBackbone=Dream-7B-Instruct2026.05 | 19.3 | 18.8 | 36.8 | 42 | 25.7 | 61.7 | 27.7 | 39.3 | |
| MDUBackbone=Dream-7B-Instruct, tau (τ)=0.252026.05 | 18.2 | 19.8 | 24.1 | 41.2 | 27.5 | 65.8 | 24.8 | 37.1 | |
| MDUBackbone=Dream-7B-Instruct, tau (τ)=0.002026.05 | 16.8 | 15.2 | 21.8 | 39.5 | 25.2 | 68.5 | 25.5 | 38.5 | |
| MDUBackbone=LLaDA-8B-Instruct, tau (τ)=1.002026.05 | 10.8 | 8.7 | 7.2 | 43.1 | 33.4 | 41.6 | 35.8 | 32.7 | |
| GABackbone=LLaDA-8B-Instruct2026.05 | 9.8 | 8.7 | 8 | 24.6 | 19.8 | 38.8 | 29.6 | 35.3 | |
| WGABackbone=LLaDA-8B-Instruct2026.05 | 8.7 | 9.5 | 8.7 | 25.5 | 21 | 40.9 | 29.8 | 35.7 | |
| SimNPOBackbone=LLaDA-8B-Instruct2026.05 | 8.6 | 8.2 | 8.6 | 25.5 | 19.2 | 39 | 29.6 | 35.3 | |
| NPOBackbone=LLaDA-8B-Instruct2026.05 | 8.5 | 7.4 | 8.1 | 25.2 | 19.1 | 38.6 | 30 | 34.5 | |
| MDUBackbone=LLaDA-8B-Instruct, tau (τ)=0.752026.05 | 6.9 | 4.7 | 9.1 | 38.3 | 30.6 | 39.5 | 28.4 | 36.4 | |
| DPOBackbone=LLaDA-8B-Instruct2026.05 | 5.8 | 9.1 | 7.6 | 26.1 | 22.1 | 38.9 | 31.8 | 35.5 | |
| MDUBackbone=LLaDA-8B-Instruct, tau (τ)=0.502026.05 | 5.3 | 2.8 | 7.8 | 34.5 | 28.6 | 41.1 | 29.2 | 35.7 | |
| MDUBackbone=LLaDA-8B-Instruct, tau (τ)=0.252026.05 | 2 | 2.4 | 3.1 | 33.4 | 27.2 | 41.8 | 27.6 | 35.4 | |
| MDUBackbone=LLaDA-8B-Instruct, tau (τ)=0.002026.05 | 1.5 | 0.6 | 1.5 | 33 | 22.5 | 41.5 | 29 | 36.4 |