List your company
ResearchFormerly WizWand

Machine Unlearning on ELUDe (retain and world)

51.3RQGuardrail
-2.05211.79925.6539.501Jun 18, 2024
Updated 8mo ago

Evaluation results

MethodLinks
GuardrailBackbone=Llama-3.1-8B-Instruct2024.0651.3
OriginalBackbone=Llama-3.1-8B-Instruct2024.0651.2
OPT-OUTBackbone=Phi-3.5-Mini-Instruct2024.0649.4
NPOBackbone=Phi-3.5-Mini-Instruct, Retention Training=true2024.0649.2
DPOBackbone=Phi-3.5-Mini-Instruct, Retention Training=true2024.0648.6
IDKBackbone=Phi-3.5-Mini-Instruct, Retention Training=true2024.0648.4
GABackbone=Phi-3.5-Mini-Instruct, Retention Training=true2024.0647.3
NPOBackbone=Llama-3.1-8B-Instruct, Retention Training=true2024.0646.6
OPT-OUTBackbone=Llama-3.1-8B-Instruct2024.0646.6
IDKBackbone=Llama-3.1-8B-Instruct, Retention Training=true2024.0646.1
GABackbone=Llama-3.1-8B-Instruct, Retention Training=true2024.0645.7
DPOBackbone=Llama-3.1-8B-Instruct, Retention Training=true2024.0644.9
OriginalBackbone=Phi-3.5-Mini-Instruct2024.0634.9
GuardrailBackbone=Phi-3.5-Mini-Instruct2024.0626.4
IDKBackbone=Phi-3.5-Mini-Instruct, Collapsed=true2024.064.3
IDKBackbone=Llama-3.1-8B-Instruct, Collapsed=true2024.063.5
GABackbone=Llama-3.1-8B-Instruct, Collapsed=true2024.060
DPOBackbone=Llama-3.1-8B-Instruct, Collapsed=true2024.060
NPOBackbone=Llama-3.1-8B-Instruct, Collapsed=true2024.060
GABackbone=Phi-3.5-Mini-Instruct2024.060
DPOBackbone=Phi-3.5-Mini-Instruct, Collapsed=true2024.060
NPOBackbone=Phi-3.5-Mini-Instruct, Collapsed=true2024.060