Machine Unlearning on PACS (test)
100Original ForgettingGA
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| GA2026.05 | 100 | 0 | 10 | 78.08 | 1 | 98.15 | 47.87 | 0 | 62.94 | |
| SLUG2026.05 | 99.75 | 33.62 | 99 | 33.99 | 99 | 0.62 | 61 | 0 | 28.16 | |
| HFRUbackbone=Qwen3-VL-4B-Instruct, configuration=Full model2026.05 | 98.75 | 99.26 | 98.5 | 99.51 | 99 | 98.65 | 98.95 | 2 | 65.79 | |
| SimNPO2026.05 | 97.25 | 72.41 | 96.5 | 65.76 | 21.75 | 93.47 | 74.52 | 0 | 42.11 | |
| GD2026.05 | 96.25 | 4.19 | 29 | 91.38 | 7.25 | 92.49 | 53.43 | 0 | 57.97 | |
| Qwen3-VL-4B-Instruct + Stage 2stage=22026.05 | 95.75 | 99.01 | 93.75 | 99.14 | 93.5 | 98.4 | 96.59 | 0 | 65.86 | |
| Qwen3-VL-4B-Instruct + Stage 1stage=12026.05 | 58 | 98.77 | 49.5 | 99.01 | 56.25 | 99.01 | 76.76 | 16 | 65.97 | |
| SAUCE2026.05 | 51.5 | 96.92 | 51 | 96.55 | 81.25 | 80.05 | 76.21 | 0 | 39.35 | |
| NPO2026.05 | 1.75 | 98.65 | 2.25 | 98.28 | 1.75 | 98.65 | 50.22 | 0 | 63.32 | |
| RMU2026.05 | 1.75 | 98.52 | 1.5 | 98.77 | 9.5 | 98.89 | 51.49 | 0 | 64.99 | |
| Qwen3-VL-4B-Instructstatus=baseline2026.05 | 1.5 | 98.65 | 1.5 | 99.01 | 0.75 | 99.13 | 50.09 | 0 | 66.2 | |
| UNDIAL2026.05 | 1.05 | 98.89 | 2.5 | 99.01 | 2.25 | 98.28 | 50.33 | 0 | 65.49 |