Machine Unlearning on RWKU Llama 3.1 8B (Neighbor Set)
95.6FBBefore
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BeforeBase Model=Llama3-Instruct (8B)2025.12 | 95.6 | 85.3 | 90.7 | |
| BeforeBase Model=Llama3.1-Instruct (8B)2025.12 | 82 | 77.3 | 79.7 | |
| CAEBase Model=Llama3-Instruct (8B)2025.12 | 79.8 | 64.5 | 72.2 | |
| BaselineLR=-2025.05 | 76.4 | 78.5 | 77.5 | |
| MELR=3e-62025.05 | 74.5 | 77.5 | 76 | |
| UndialLR=2e-72025.05 | 74.4 | 78.3 | 76.3 | |
| GALR=2e-62025.05 | 73.6 | 74.4 | 74 | |
| UndialLR=6e-72025.05 | 73.6 | 77.4 | 75.5 | |
| UndialLR=5e-62025.05 | 71.9 | 74.5 | 73.2 | |
| CAEBase Model=Llama3.1-Instruct (8B)2025.12 | 64.5 | 64.8 | 64.7 | |
| UnilogitLR=2e-72025.05 | 63.8 | 67.5 | 65.7 | |
| UndialLR=1e-52025.05 | 62.1 | 69 | 65.5 | |
| NPOLR=2e-62025.05 | 57.9 | 62 | 60 | |
| UnilogitLR=5e-72025.05 | 44.8 | 41.7 | 43.2 | |
| RKLDLR=1e-52025.05 | 36.6 | 30.1 | 33.4 |