Knowledge Unlearning Evaluation on WMDP
34.6ScoreRMU w/ RNA
Evaluation results
| Method | Links | |
|---|---|---|
| RMU w/ RNAModel Backbone=Llama-3-8B, Unlearning Method=RMU, RNA Configuration=w/ RNA2025.01 | 34.6 | |
| NPO+KL w/ RNAModel Backbone=Mistral-7B, Unlearning Method=NPO+KL, RNA Configuration=w/ RNA2025.01 | 34 | |
| NPO+KL w/ RNAModel Backbone=Llama-3-8B, Unlearning Method=NPO+KL, RNA Configuration=w/ RNA2025.01 | 33.2 | |
| RMUModel Backbone=Mistral-7B, Unlearning Method=RMU, RNA Configuration=Original2025.01 | 31.7 | |
| RMU w/ RNAModel Backbone=Mistral-7B, Unlearning Method=RMU, RNA Configuration=w/ RNA2025.01 | 31.7 | |
| RMUModel Backbone=Llama-3-8B, Unlearning Method=RMU, RNA Configuration=Original2025.01 | 31.4 | |
| NPO+KLModel Backbone=Mistral-7B, Unlearning Method=NPO+KL, RNA Configuration=Original2025.01 | 29.3 | |
| NPO+KLModel Backbone=Llama-3-8B, Unlearning Method=NPO+KL, RNA Configuration=Original2025.01 | 27.9 |