Knowledge Retention on WMDP retain
48.3RetainNPO
Evaluation Results
| Method | Links | |
|---|---|---|
| NPOModel=Gemma-3-4B, Unlearning Domain=bio2026.05 | 48.3 | |
| SimNPOModel=Gemma-3-4B, Unlearning Domain=bio2026.05 | 47.8 | |
| GU+SimNPOModel=Gemma-3-4B, Unlearning Domain=bio2026.05 | 47.1 | |
| MANSUModel=Gemma-3-4B, Unlearning Domain=bio2026.05 | 40.5 | |
| NPOModel=Gemma-3-4B, Unlearning Domain=chem2026.05 | 38.8 | |
| SimNPOModel=Gemma-3-4B, Unlearning Domain=chem2026.05 | 35.6 | |
| MANSUModel=Gemma-3-1B, Unlearning Domain=bio2026.05 | 35.1 | |
| GU+SimNPOModel=Gemma-3-4B, Unlearning Domain=chem2026.05 | 35.1 | |
| NPOModel=Gemma-3-4B, Unlearning Domain=cyber2026.05 | 34.9 | |
| SimNPOModel=Gemma-3-4B, Unlearning Domain=cyber2026.05 | 34.7 | |
| GU+SimNPOModel=Gemma-3-4B, Unlearning Domain=cyber2026.05 | 34.1 | |
| MANSUModel=Gemma-2B, Unlearning Domain=bio2026.05 | 33.8 | |
| NPOModel=Gemma-3-1B, Unlearning Domain=bio2026.05 | 33 | |
| MANSUModel=Gemma-3-4B, Unlearning Domain=cyber2026.05 | 32.8 | |
| SimNPOModel=Gemma-3-1B, Unlearning Domain=bio2026.05 | 32.7 | |
| GU+SimNPOModel=Gemma-3-1B, Unlearning Domain=bio2026.05 | 32.3 | |
| NPOModel=Gemma-2B, Unlearning Domain=chem2026.05 | 31.5 | |
| NPOModel=Gemma-3-1B, Unlearning Domain=chem2026.05 | 31.5 | |
| MANSUModel=Gemma-2B, Unlearning Domain=cyber2026.05 | 31.4 | |
| MANSUModel=Gemma-3-4B, Unlearning Domain=chem2026.05 | 31.4 | |
| GU+SimNPOModel=Gemma-2B, Unlearning Domain=bio2026.05 | 31.3 | |
| SimNPOModel=Gemma-2B, Unlearning Domain=bio2026.05 | 31.3 | |
| GU+SimNPOModel=Gemma-2B, Unlearning Domain=cyber2026.05 | 30.3 | |
| SimNPOModel=Gemma-2B, Unlearning Domain=cyber2026.05 | 30.3 | |
| NPOModel=Gemma-2B, Unlearning Domain=bio2026.05 | 30 | |
| MANSUModel=Gemma-3-1B, Unlearning Domain=cyber2026.05 | 29.1 | |
| MANSUModel=Gemma-3-1B, Unlearning Domain=chem2026.05 | 28.4 | |
| NPOModel=Gemma-3-1B, Unlearning Domain=cyber2026.05 | 28.3 | |
| MANSUModel=Gemma-2B, Unlearning Domain=chem2026.05 | 27.8 | |
| GU+SimNPOModel=Gemma-3-1B, Unlearning Domain=cyber2026.05 | 27.7 | |
| SimNPOModel=Gemma-3-1B, Unlearning Domain=cyber2026.05 | 27.3 | |
| GU+SimNPOModel=Gemma-2B, Unlearning Domain=chem2026.05 | 26.9 | |
| SimNPOModel=Gemma-2B, Unlearning Domain=chem2026.05 | 26.9 | |
| NPOModel=Gemma-2B, Unlearning Domain=cyber2026.05 | 23 | |
| SimNPOModel=Gemma-3-1B, Unlearning Domain=chem2026.05 | 21.3 | |
| GU+SimNPOModel=Gemma-3-1B, Unlearning Domain=chem2026.05 | 20.4 |