General Knowledge Evaluation on MMLU Computer Security
46AccuracyNPO+KL w/ RNA
Evaluation results
| Method | Links | |
|---|---|---|
| NPO+KL w/ RNAModel Backbone=Llama-3-8B, Unlearning Method=NPO+KL, RNA Configuration=w/ RNA2025.01 | 46 | |
| RMU w/ RNAModel Backbone=Mistral-7B, Unlearning Method=RMU, RNA Configuration=w/ RNA2025.01 | 46 | |
| NPO+KLModel Backbone=Mistral-7B, Unlearning Method=NPO+KL, RNA Configuration=Original2025.01 | 35 | |
| RMU w/ RNAModel Backbone=Llama-3-8B, Unlearning Method=RMU, RNA Configuration=w/ RNA2025.01 | 33 | |
| RMUModel Backbone=Mistral-7B, Unlearning Method=RMU, RNA Configuration=Original2025.01 | 33 | |
| NPO+KLModel Backbone=Llama-3-8B, Unlearning Method=NPO+KL, RNA Configuration=Original2025.01 | 30 | |
| NPO+KL w/ RNAModel Backbone=Mistral-7B, Unlearning Method=NPO+KL, RNA Configuration=w/ RNA2025.01 | 30 | |
| RMUModel Backbone=Llama-3-8B, Unlearning Method=RMU, RNA Configuration=Original2025.01 | 29 |