General Knowledge Evaluation on MMLU Corporate Biology
60.4AccuracyRMU w/ RNA
Evaluation results
| Method | Links | |
|---|---|---|
| RMU w/ RNAModel Backbone=Llama-3-8B, Unlearning Method=RMU, RNA Configuration=w/ RNA2025.01 | 60.4 | |
| NPO+KL w/ RNAModel Backbone=Llama-3-8B, Unlearning Method=NPO+KL, RNA Configuration=w/ RNA2025.01 | 55.5 | |
| NPO+KL w/ RNAModel Backbone=Mistral-7B, Unlearning Method=NPO+KL, RNA Configuration=w/ RNA2025.01 | 52 | |
| RMU w/ RNAModel Backbone=Mistral-7B, Unlearning Method=RMU, RNA Configuration=w/ RNA2025.01 | 38.1 | |
| RMUModel Backbone=Llama-3-8B, Unlearning Method=RMU, RNA Configuration=Original2025.01 | 34.7 | |
| NPO+KLModel Backbone=Mistral-7B, Unlearning Method=NPO+KL, RNA Configuration=Original2025.01 | 32.6 | |
| NPO+KLModel Backbone=Llama-3-8B, Unlearning Method=NPO+KL, RNA Configuration=Original2025.01 | 30.5 | |
| RMUModel Backbone=Mistral-7B, Unlearning Method=RMU, RNA Configuration=Original2025.01 | 25 |