Unlearning Detection on WMDP
100AccuracyLLaMA-3.1-8B + Activation-based Detection
Evaluation results
| Method | Links | |
|---|---|---|
| LLaMA-3.1-8B + Activation-based DetectionModel=LLaMA-3.1-8B, Unlearning method=RMU, Feature type=RMS-normalized final-layer activations, Classifier=two-layer MLP, Unlearning target=WMDP2025.06 | 100 | |
| Yi-34B + Activation-based DetectionModel=Yi-34B, Unlearning method=RMU, Feature type=RMS-normalized final-layer activations, Classifier=two-layer MLP, Unlearning target=WMDP2025.06 | 100 | |
| Zephyr-7BUnlearning Method=NPO, Input Features=RMS-normalized final-layer activations, Unlearning Target Dataset=WMDP2025.06 | 100 | |
| LLaMA-3.1-8BUnlearning Method=NPO, Input Features=RMS-normalized final-layer activations, Unlearning Target Dataset=WMDP2025.06 | 100 | |
| LLaMA-3.1-8BUnlearning method=NPO, Detection source=Text-based2025.06 | 100 | |
| Qwen2.5-14BUnlearning Method=NPO, Input Features=RMS-normalized final-layer activations, Unlearning Target Dataset=WMDP2025.06 | 99.86 | |
| Yi-34BUnlearning method=NPO, Detection source=Text-based2025.06 | 99.86 | |
| Zephyr-7B + Activation-based DetectionModel=Zephyr-7B, Unlearning method=RMU, Feature type=RMS-normalized final-layer activations, Classifier=two-layer MLP, Unlearning target=WMDP2025.06 | 99.72 | |
| Yi-34BUnlearning Method=NPO, Input Features=RMS-normalized final-layer activations, Unlearning Target Dataset=WMDP2025.06 | 99.72 | |
| Zephyr-7BUnlearning method=NPO, Detection source=Text-based2025.06 | 99.72 | |
| Qwen2.5-14BUnlearning method=NPO, Detection source=Text-based2025.06 | 99.72 | |
| Qwen2.5-14B + Activation-based DetectionModel=Qwen2.5-14B, Unlearning method=RMU, Feature type=RMS-normalized final-layer activations, Classifier=two-layer MLP, Unlearning target=WMDP2025.06 | 98.59 | |
| unlearning trace detectionModel=Qwen2.5-14B2025.06 | 95.07 | |
| unlearning trace detectionModel=Yi-34B2025.06 | 94.37 | |
| unlearning trace detectionModel=LLaMA-3.1-8B2025.06 | 93.24 | |
| unlearning trace detectionModel=Zephyr-7B2025.06 | 90.56 |