Unlearning on SciQ-WMDP-Bio (test)
68.7Concept AccuracyFT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| FTModel Architecture=Llama-3.12026.07 | 68.7 | 76.5 | 63.8 | |
| BaseModel Architecture=Llama-3.12026.07 | 61.3 | 68.4 | 65 | |
| AugModel Architecture=Llama-3.12026.07 | 42.4 | 74.6 | 56.6 | |
| FTModel Architecture=Mistral-7B2026.07 | 41.2 | 42.6 | 52.7 | |
| AugModel Architecture=Mistral-7B2026.07 | 40 | 41 | 51.5 | |
| BaseModel Architecture=Mistral-7B2026.07 | 35.3 | 38.5 | 56.1 | |
| MPTuneModel Architecture=Mistral-7B2026.07 | 33 | 41.5 | 51.7 | |
| ECKModel Architecture=Llama-3.12026.07 | 32.2 | — | 61.6 | |
| MPTuneModel Architecture=Llama-3.12026.07 | 31.8 | 75.6 | 64.1 | |
| MPSelectTuneModel Architecture=Mistral-7B2026.07 | 30.3 | 40.7 | 52.1 | |
| MPSelectTuneModel Architecture=Llama-3.12026.07 | 29.9 | 75.4 | 64.3 | |
| FTModel Architecture=Llama-22026.07 | 26.1 | 25.4 | 24.6 | |
| MPTuneModel Architecture=Llama-22026.07 | 25.4 | 25.4 | 24 | |
| MPSelectTuneModel Architecture=Llama-22026.07 | 25.1 | 24.8 | 24.3 | |
| BaseModel Architecture=Llama-22026.07 | 19.7 | 23.1 | 43.9 | |
| AugModel Architecture=Llama-22026.07 | 19.6 | 21.7 | 26.7 |