Machine Unlearning on PACS Sketch (OOD)
100Original Forgetting RateGA
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| GA2026.05 | 100 | 0 | 42.2 | 66.94 | 11.9 | 92.35 | 52.23 | |
| GD2026.05 | 100 | 0 | 92.39 | 77.2 | 58.73 | 65 | 65.55 | |
| RMU2026.05 | 100 | 0 | 100 | 0 | 45.44 | 86.35 | 55.3 | |
| SAUCE2026.05 | 100 | 0 | 68.98 | 59.58 | 41.89 | 37.65 | 54.8 | |
| SLUG2026.05 | 99.87 | 6.7 | 99.74 | 7.65 | 98.48 | 1.45 | 52.32 | |
| SLUG2026.05 | 99.47 | 18.49 | 99.67 | 14.94 | 99.54 | 5.75 | 56.31 | |
| HFRUvariant=Full, backbone=Qwen2.5-VL-3B-Instruct2026.05 | 99.47 | 95.12 | 100 | 94.91 | 98.88 | 95.37 | 97.29 | |
| Qwen3-VL-4B-Instruct + HFRUunlearning_method=HFRU2026.05 | 99.4 | 94 | 98.54 | 94.25 | 99.34 | 94.41 | 96.66 | |
| HFRUvariant=Stage 2, backbone=Qwen2.5-VL-3B-Instruct2026.05 | 99.01 | 94.87 | 99.6 | 94.12 | 99.33 | 94.62 | 96.93 | |
| GD2026.05 | 98.28 | 3.81 | 36.38 | 80.35 | 12.3 | 91.44 | 53.76 | |
| GA2026.05 | 98.08 | 3.48 | 36.84 | 79.48 | 12.43 | 92.01 | 53.72 | |
| SimNPO2026.05 | 97.82 | 69.63 | 93.92 | 65.54 | 19.44 | 99.05 | 74.23 | |
| SimNPO2026.05 | 97.82 | 80.68 | 93.65 | 90.73 | 100 | 0 | 77.15 | |
| Qwen3-VL-4B-Instruct + Stage 2unlearning_stage=22026.05 | 93.32 | 95.53 | 92.2 | 95.41 | 99.14 | 95.12 | 95.12 | |
| HFRUvariant=Stage 1, backbone=Qwen2.5-VL-3B-Instruct2026.05 | 78.44 | 86.8 | 75.07 | 86.14 | 45.97 | 81.09 | 76.93 | |
| Qwen3-VL-4B-Instruct + Stage 1unlearning_stage=12026.05 | 78.31 | 90.36 | 60.45 | 90.44 | 47.86 | 91.44 | 76.48 | |
| SAUCE2026.05 | 63.96 | 92.93 | 59.52 | 93.67 | 71.36 | 70.13 | 75.26 | |
| UNDIAL2026.05 | 63.29 | 64.15 | 53.11 | 65.78 | 2.78 | 97.68 | 57.8 | |
| NPO2026.05 | 37.17 | 94.62 | 37.24 | 94.75 | 19.25 | 87.05 | 61.68 | |
| Qwen2.5-VL-3B-Instructstatus=base model2026.05 | 24.14 | 86.72 | 28.97 | 85.56 | 12.04 | 91.73 | 54.86 | |
| NPO2026.05 | 17.06 | 94.66 | 16.7 | 94.54 | 13.43 | 91.35 | 54.62 | |
| RMU2026.05 | 13.82 | 91.97 | 14.02 | 92.39 | 30.03 | 93.46 | 55.95 | |
| Qwen3-VL-4B-Instruct2026.05 | 12.17 | 91.97 | 11.77 | 92.1 | 9.13 | 93.55 | 77.47 | |
| UNDIAL2026.05 | 11.18 | 89.62 | 10.78 | 89.33 | 10.05 | 93.26 | 50.7 |