Unlearning on Bios Dataset
99.82Task AccuracyFT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| FTModel=Llama-2-7B2026.07 | 99.82 | 99.96 | 42.1 | 1.9 | |
| MPTuneModel=Llama-2-7B2026.07 | 99.82 | 61.57 | 42.8 | 1.2 | |
| MPSelectTuneModel=Llama-2-7B2026.07 | 99.79 | 55.6 | 42.9 | 1.1 | |
| FTModel=Llama-3.1-8B2026.07 | 99.43 | 98.7 | 63.1 | 3 | |
| MPTuneModel=Llama-3.1-8B2026.07 | 99.36 | 59.36 | 64.2 | 1.7 | |
| MPSelectTuneModel=Llama-3.1-8B2026.07 | 99.25 | 56.61 | 64.3 | 1.9 | |
| AugModel=Llama-3.1-8B2026.07 | 97.46 | 88.76 | 58.9 | 5.2 | |
| FTModel=Mistral-7B-Instruct-v0.32026.07 | 96.6 | 94.7 | 53.7 | 2.5 | |
| AugModel=Llama-2-7B2026.07 | 95.04 | 92.81 | 37.6 | 6.5 | |
| AugModel=Mistral-7B-Instruct-v0.32026.07 | 93.8 | 90.2 | 52.6 | 6.7 | |
| MPTuneModel=Mistral-7B-Instruct-v0.32026.07 | 92.5 | 63.8 | 54 | 2.3 | |
| MPSelectTuneModel=Mistral-7B-Instruct-v0.32026.07 | 92.1 | 61.1 | 53.8 | 2.1 | |
| ICULModel=Mistral-7B-Instruct-v0.32026.07 | 90.3 | 67.4 | 53.7 | 10.1 | |
| BaseModel=Llama-3.1-8B2026.07 | 90.14 | 96.33 | 65 | 10 | |
| BaseModel=Llama-2-7B2026.07 | 89.5 | 93.4 | 43.9 | 13.2 | |
| ICULModel=Llama-3.1-8B2026.07 | 87.46 | 73.86 | 63.1 | 14.9 | |
| BaseModel=Mistral-7B-Instruct-v0.32026.07 | 84.4 | 91.9 | 56.1 | 12.9 | |
| ICULModel=Llama-2-7B2026.07 | 84.36 | 83.64 | 42.1 | 18.5 | |
| SKUModel=Llama-3.1-8B2026.07 | 78.32 | 74.86 | 31.9 | 22.5 | |
| SKUModel=Mistral-7B-Instruct-v0.32026.07 | 75.6 | 68.9 | 52.3 | 15.6 | |
| SKUModel=Llama-2-7B2026.07 | 72.75 | 65.55 | 34.9 | 30.2 |