Knowledge Unlearning on RWKU (Forget Set)
85.9FBBefore
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Beforestate=original model2026.02 | 85.9 | 76.4 | 77.7 | 79.6 | |
| RTadaptation=LoRA2026.02 | 85.4 | 49.6 | 53.2 | 60.5 | |
| DPOadaptation=LoRA2026.02 | 75.3 | 65.4 | 68.6 | 69.5 | |
| NPOadaptation=LoRA2026.02 | 75.1 | 64.3 | 69 | 69.7 | |
| BeforeBackbone=Llama-2-7b-chat2026.04 | 67.88 | 67.21 | 68.29 | 67.79 | |
| GAadaptation=LoRA2026.02 | 67 | 53.2 | 61.8 | 61.3 | |
| DirectQAFinetuning Strategy=NPO, Backbone=Llama-2-7b-chat2026.04 | 65.39 | 68.42 | 71.39 | 68.4 | |
| DirectQAFinetuning Strategy=GA, Backbone=Llama-2-7b-chat2026.04 | 65.31 | 66.75 | 70.3 | 67.45 | |
| RWKUFinetuning Strategy=NPO, Backbone=Llama-2-7b-chat2026.04 | 64.44 | 61.28 | 66.31 | 64.01 | |
| ELUDeFinetuning Strategy=GA, Backbone=Llama-2-7b-chat2026.04 | 64.4 | 46.46 | 60.26 | 57.04 | |
| MAGEFinetuning Strategy=GA, Backbone=Llama-2-7b-chat2026.04 | 63.73 | 42.88 | 54.38 | 53.66 | |
| MAGEFinetuning Strategy=GA+KL, Backbone=Llama-2-7b-chat2026.04 | 63.19 | 43.64 | 55.38 | 54.07 | |
| ELUDeFinetuning Strategy=GA+KL, Backbone=Llama-2-7b-chat2026.04 | 61.7 | 44.75 | 57.97 | 54.8 | |
| MAGEFinetuning Strategy=GA+GD, Backbone=Llama-2-7b-chat2026.04 | 59.28 | 36.44 | 50.12 | 48.61 | |
| ELUDeFinetuning Strategy=GA+GD, Backbone=Llama-2-7b-chat2026.04 | 58.59 | 40.06 | 52.57 | 50.41 | |
| RWKUFinetuning Strategy=GA, Backbone=Llama-2-7b-chat2026.04 | 58.17 | 55.11 | 65.36 | 59.55 | |
| DirectQAFinetuning Strategy=GA+KL, Backbone=Llama-2-7b-chat2026.04 | 58.12 | 61.52 | 69.68 | 63.11 | |
| DirectQAFinetuning Strategy=GA+GD, Backbone=Llama-2-7b-chat2026.04 | 54.68 | 60.38 | 67.72 | 60.92 | |
| RWKUFinetuning Strategy=GA+GD, Backbone=Llama-2-7b-chat2026.04 | 51.08 | 45.83 | 60.75 | 52.55 | |
| RWKUFinetuning Strategy=GA+KL, Backbone=Llama-2-7b-chat2026.04 | 51.08 | 46.44 | 61.28 | 52.93 | |
| ELUDeFinetuning Strategy=NPO, Backbone=Llama-2-7b-chat2026.04 | 42.9 | 27.18 | 40.61 | 36.9 | |
| MAGEFinetuning Strategy=NPO, Backbone=Llama-2-7b-chat2026.04 | 41.77 | 19.78 | 37.34 | 32.96 | |
| NEDSadaptation=LoRA2026.02 | 38.4 | 58.8 | 55.4 | 50.9 |