Machine Unlearning on TOFU (Forget01)
-396.8fLPTimeROME (α=2,q=4)
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| TimeROME (α=2,q=4)Backbone=Dream-7B2026.06 | -396.8 | — | — | — | — | — | — | — | 14 | |
| AlphaEditBackbone=Dream-7B2026.06 | -315.7 | — | — | — | — | — | — | — | 63 | |
| RMU (Adapt.)Backbone=Dream-7B2026.06 | -313.9 | — | — | — | — | — | — | — | 69 | |
| SimNPOBackbone=Dream-7B2026.06 | -313.6 | — | — | — | — | — | — | — | 69 | |
| no_editBackbone=Dream-7B2026.06 | -312.1 | — | — | — | — | — | — | — | 72 | |
| TimeROME (α=2,q=4)Backbone=MMaDA-8B2026.06 | -132.4 | — | — | — | — | — | — | — | 18 | |
| TimeROME (α=2,q=4)Backbone=LLaDA-8B-Base2026.06 | -118.9 | — | — | — | — | — | — | — | 15 | |
| TimeROME (α=2,q=4)Backbone=DiffuLLaMA-7B2026.06 | -111.8 | — | — | — | — | — | — | — | 21 | |
| TimeROME (α=2,q=4)Backbone=LLaDA-MoE-1.4B2026.06 | -83.6 | — | — | — | — | — | — | — | 19 | |
| TimeROME (α=2,q=4)Backbone=LLaDA-8B-Instr.2026.06 | -78 | — | — | — | — | — | — | — | 20 | |
| AlphaEditBackbone=MMaDA-8B2026.06 | -52.4 | — | — | — | — | — | — | — | 52 | |
| AlphaEditBackbone=DiffuLLaMA-7B2026.06 | -50.9 | — | — | — | — | — | — | — | 54 | |
| AlphaEditBackbone=LLaDA-8B-Instr.2026.06 | -49.8 | — | — | — | — | — | — | — | 41 | |
| RMU (Adapt.)Backbone=MMaDA-8B2026.06 | -49.1 | — | — | — | — | — | — | — | 53 | |
| AlphaEditBackbone=LLaDA-8B-Base2026.06 | -47.6 | — | — | — | — | — | — | — | 55 | |
| RMU (Adapt.)Backbone=DiffuLLaMA-7B2026.06 | -47.6 | — | — | — | — | — | — | — | 52 | |
| RMU (Adapt.)Backbone=LLaDA-8B-Instr.2026.06 | -46.9 | — | — | — | — | — | — | — | 40 | |
| SimNPOBackbone=MMaDA-8B2026.06 | -45.9 | — | — | — | — | — | — | — | 53 | |
| RMU (Adapt.)Backbone=LLaDA-8B-Base2026.06 | -45.3 | — | — | — | — | — | — | — | 58 | |
| SimNPOBackbone=LLaDA-8B-Instr.2026.06 | -44.2 | — | — | — | — | — | — | — | 39 | |
| SimNPOBackbone=DiffuLLaMA-7B2026.06 | -43.7 | — | — | — | — | — | — | — | 51 | |
| SimNPOBackbone=LLaDA-8B-Base2026.06 | -42.8 | — | — | — | — | — | — | — | 56 | |
| AlphaEditBackbone=LLaDA-MoE-1.4B2026.06 | -41.3 | — | — | — | — | — | — | — | 50 | |
| no_editBackbone=MMaDA-8B2026.06 | -41.1 | — | — | — | — | — | — | — | 49 | |
| no_editBackbone=DiffuLLaMA-7B2026.06 | -38.6 | — | — | — | — | — | — | — | 51 | |
| RMU (Adapt.)Backbone=LLaDA-MoE-1.4B2026.06 | -38.6 | — | — | — | — | — | — | — | 52 | |
| SimNPOBackbone=LLaDA-MoE-1.4B2026.06 | -37.6 | — | — | — | — | — | — | — | 51 | |
| no_editBackbone=LLaDA-8B-Instr.2026.06 | -37 | — | — | — | — | — | — | — | 32 | |
| no_editBackbone=LLaDA-8B-Base2026.06 | -35.7 | — | — | — | — | — | — | — | 51 | |
| no_editBackbone=LLaDA-MoE-1.4B2026.06 | -33.9 | — | — | — | — | — | — | — | 50 | |
| BaseModel=Zephyr-7B-beta2026.02 | — | 0.04 | 0 | 0.01 | 7.27 | 8.61 | 8.51 | — | — | |
| GradAscentModel=Zephyr-7B-beta2026.02 | — | 0.96 | 0.01 | 0 | 0.12 | 0.01 | 0.01 | — | — | |
| GradDiffModel=Zephyr-7B-beta2026.02 | — | 1.04 | 0.01 | 0.01 | 0.31 | 0.52 | 0.56 | — | — | |
| Guardrail ClassifierBackbone=Llama-3-8B-Instruct2026.05 | — | — | — | — | — | — | — | 1 | — | |
| Guardrail ClassifierBackbone=Llama-2-7B-chat-hf2026.05 | — | — | — | — | — | — | — | 1 | — | |
| Guardrail FilterBackbone=Llama-3-8B-Instruct2026.05 | — | — | — | — | — | — | — | 0.675 | — | |
| Guardrail FilterBackbone=Llama-2-7B-chat-hf2026.05 | — | — | — | — | — | — | — | 0.225 | — | |
| ICCUBackbone=Llama-3-8B-Instruct2026.05 | — | — | — | — | — | — | — | 0.975 | — | |
| ICCUBackbone=Llama-2-7B-chat-hf2026.05 | — | — | — | — | — | — | — | 0.975 | — | |
| KLModel=Zephyr-7B-beta2026.02 | — | 0.17 | 0 | 0 | 6.23 | 7.47 | 7.95 | — | — | |
| NPOModel=Zephyr-7B-beta2026.02 | — | 0.16 | 0 | 0.05 | 3.68 | 5.14 | 6.41 | — | — | |
| POModel=Zephyr-7B-beta2026.02 | — | 0.12 | 0.05 | 0 | 5.18 | 6.91 | 7.55 | — | — | |
| RMUModel=Zephyr-7B-beta2026.02 | — | 0.12 | 0 | 0.05 | 3.97 | 5.56 | 6.88 | — | — | |
| TRUModel=Zephyr-7B-beta2026.02 | — | 5.15 | 5.65 | 6.9 | 7.12 | 4.23 | 5.07 | — | — | |
| WGAModel=Zephyr-7B-beta2026.02 | — | 0.12 | 0 | 0.01 | 6 | 7.46 | 8.2 | — | — |