General Knowledge Evaluation on MMLU Perturbed
53.5AccuracyNPO+KL w/ RNA
Evaluation results
| Method | Links | |
|---|---|---|
| NPO+KL w/ RNAModel Backbone=Mistral-7B, Unlearning Method=NPO+KL, RNA Configuration=w/ RNA2025.01 | 53.5 | |
| RMU w/ RNAModel Backbone=Llama-3-8B, Unlearning Method=RMU, RNA Configuration=w/ RNA2025.01 | 47.3 | |
| NPO+KL w/ RNAModel Backbone=Llama-3-8B, Unlearning Method=NPO+KL, RNA Configuration=w/ RNA2025.01 | 47.3 | |
| RMU w/ RNAModel Backbone=Mistral-7B, Unlearning Method=RMU, RNA Configuration=w/ RNA2025.01 | 42.2 | |
| RMUModel Backbone=Llama-3-8B, Unlearning Method=RMU, RNA Configuration=Original2025.01 | 34.4 | |
| NPO+KLModel Backbone=Mistral-7B, Unlearning Method=NPO+KL, RNA Configuration=Original2025.01 | 31.4 | |
| RMUModel Backbone=Mistral-7B, Unlearning Method=RMU, RNA Configuration=Original2025.01 | 27.2 | |
| NPO+KLModel Backbone=Llama-3-8B, Unlearning Method=NPO+KL, RNA Configuration=Original2025.01 | 26.2 |