Machine Unlearning on RWKU Llama 3.1 8B (Forget Set)
85.9FB ScoreBefore
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| BeforeBase Model=Llama3-Instruct (8B)2025.12 | 85.9 | 76.4 | 77.7 | 79.6 | |
| RTBase Model=Llama3-Instruct (8B), Tuning=LoRA2025.12 | 85.4 | 49.6 | 53.2 | 60.5 | |
| DPOBase Model=Llama3-Instruct (8B), Tuning=LoRA2025.12 | 75.3 | 65.4 | 68.6 | 69.5 | |
| NPOBase Model=Llama3-Instruct (8B), Tuning=LoRA2025.12 | 75.1 | 64.3 | 69 | 69.7 | |
| RTBase Model=Llama3-Instruct (8B), Tuning=Full2025.12 | 72.7 | 13.4 | 22.8 | 33.1 | |
| BeforeBase Model=Llama3.1-Instruct (8B)2025.12 | 67.5 | 68.1 | 68.1 | 67.9 | |
| GABase Model=Llama3-Instruct (8B), Tuning=LoRA2025.12 | 67 | 53.2 | 61.8 | 61.3 | |
| BaselineLR=-2025.05 | 65 | 69.9 | 70.3 | 68.4 | |
| AlphaEditBase Model=Llama3.1-Instruct (8B)2025.12 | 64.6 | 58.8 | 63.8 | 62.4 | |
| MELR=3e-62025.05 | 64.4 | 70 | 69.8 | 68.1 | |
| NPOBase Model=Llama3.1-Instruct (8B), Tuning=LoRA2025.12 | 64.3 | 62.4 | 64.6 | 63.8 | |
| AlphaEditBase Model=Llama3-Instruct (8B)2025.12 | 62.7 | 52.6 | 58.9 | 58.1 | |
| GABase Model=Llama3.1-Instruct (8B), Tuning=LoRA2025.12 | 60.2 | 55.8 | 61.4 | 59.1 | |
| UndialLR=2e-72025.05 | 57.7 | 59.9 | 64.1 | 60.6 | |
| UndialLR=6e-72025.05 | 57.2 | 56.5 | 62.4 | 58.7 | |
| UndialLR=1e-52025.05 | 56.9 | 54.4 | 60.3 | 57.2 | |
| UndialLR=5e-62025.05 | 56.3 | 53.5 | 60.8 | 56.9 | |
| RTBase Model=Llama3.1-Instruct (8B), Tuning=LoRA2025.12 | 54.5 | 50.9 | 47.5 | 50.9 | |
| DPOBase Model=Llama3-Instruct (8B), Tuning=Full2025.12 | 46.3 | 38.5 | 41.6 | 41.9 | |
| DPOBase Model=Llama3.1-Instruct (8B), Tuning=Full2025.12 | 39.8 | 32.3 | 36.4 | 36.2 | |
| GABase Model=Llama3-Instruct (8B), Tuning=Full2025.12 | 39.1 | 31.6 | 46.7 | 41.9 | |
| GALR=2e-62025.05 | 37.5 | 33.8 | 46.6 | 39.3 | |
| GABase Model=Llama3.1-Instruct (8B), Tuning=Full2025.12 | 37.2 | 29.7 | 43.6 | 36.9 | |
| EMMETBase Model=Llama3.1-Instruct (8B)2025.12 | 36.1 | 29 | 45.2 | 36.8 | |
| NPOBase Model=Llama3-Instruct (8B), Tuning=Full2025.12 | 33.4 | 21 | 24.8 | 26.2 | |
| MEMITBase Model=Llama3.1-Instruct (8B)2025.12 | 30.5 | 23.6 | 41.6 | 31.9 | |
| RepEBase Model=Llama3-Instruct (8B)2025.12 | 29.8 | 33.6 | 37.8 | 34.8 | |
| MEMITBase Model=Llama3-Instruct (8B)2025.12 | 29.7 | 18.6 | 31.4 | 26.6 | |
| EMMETBase Model=Llama3-Instruct (8B)2025.12 | 28.2 | 22.6 | 36.1 | 29 | |
| NPOBase Model=Llama3.1-Instruct (8B), Tuning=Full2025.12 | 27.6 | 18.6 | 21.5 | 22.5 | |
| ICUBase Model=Llama3-Instruct (8B)2025.12 | 26.2 | 1.9 | 10.3 | 12.8 | |
| RKLDLR=1e-52025.05 | 25.6 | 28 | 30.9 | 28.1 | |
| NPOLR=2e-62025.05 | 24 | 16.1 | 17.9 | 19.3 | |
| ICUBase Model=Llama3.1-Instruct (8B)2025.12 | 21.8 | 5.3 | 9 | 12 | |
| UnilogitLR=2e-72025.05 | 20.5 | 15.4 | 25.4 | 20.4 | |
| CAEBase Model=Llama3.1-Instruct (8B)2025.12 | 18.7 | 12.4 | 28.4 | 19.8 | |
| CAEBase Model=Llama3-Instruct (8B)2025.12 | 18.2 | 7.4 | 22 | 15.9 | |
| RTBase Model=Llama3.1-Instruct (8B), Tuning=Full2025.12 | 16.8 | 15 | 12.7 | 14.8 | |
| UnilogitLR=5e-72025.05 | 5.7 | 3.7 | 8.1 | 5.8 |