Machine Unlearning on ELUDe (forget)
89.7FQNPO
Evaluation results
| Method | Links | |
|---|---|---|
| NPOBackbone=Llama-3.1-8B-Instruct, Collapsed=true2024.06 | 89.7 | |
| OPT-OUTBackbone=Llama-3.1-8B-Instruct2024.06 | 87.8 | |
| DPOBackbone=Llama-3.1-8B-Instruct, Retention Training=true2024.06 | 84.9 | |
| IDKBackbone=Llama-3.1-8B-Instruct, Collapsed=true2024.06 | 84.3 | |
| NPOBackbone=Llama-3.1-8B-Instruct, Retention Training=true2024.06 | 82.6 | |
| NPOBackbone=Phi-3.5-Mini-Instruct, Collapsed=true2024.06 | 80.7 | |
| IDKBackbone=Phi-3.5-Mini-Instruct, Collapsed=true2024.06 | 80.4 | |
| DPOBackbone=Phi-3.5-Mini-Instruct, Collapsed=true2024.06 | 78.3 | |
| GABackbone=Llama-3.1-8B-Instruct, Retention Training=true2024.06 | 77.1 | |
| OPT-OUTBackbone=Phi-3.5-Mini-Instruct2024.06 | 76.5 | |
| DPOBackbone=Llama-3.1-8B-Instruct, Collapsed=true2024.06 | 76.3 | |
| IDKBackbone=Llama-3.1-8B-Instruct, Retention Training=true2024.06 | 71.9 | |
| GABackbone=Llama-3.1-8B-Instruct, Collapsed=true2024.06 | 70.9 | |
| IDKBackbone=Phi-3.5-Mini-Instruct, Retention Training=true2024.06 | 68.6 | |
| GABackbone=Phi-3.5-Mini-Instruct, Retention Training=true2024.06 | 67.7 | |
| NPOBackbone=Phi-3.5-Mini-Instruct, Retention Training=true2024.06 | 67.5 | |
| DPOBackbone=Phi-3.5-Mini-Instruct, Retention Training=true2024.06 | 67.4 | |
| GuardrailBackbone=Llama-3.1-8B-Instruct2024.06 | 64.8 | |
| GABackbone=Phi-3.5-Mini-Instruct2024.06 | 63.6 | |
| GuardrailBackbone=Phi-3.5-Mini-Instruct2024.06 | 46.6 | |
| OriginalBackbone=Llama-3.1-8B-Instruct2024.06 | 45.5 | |
| OriginalBackbone=Phi-3.5-Mini-Instruct2024.06 | 44.9 |