List your company

Machine Unlearning on PACS Sketch (OOD)

100Original Forgetting RateGA
7.627231.608655.5979.5714May 8, 2026

Evaluation results

MethodLinks
GA2026.05100042.266.9411.992.3552.23
GD2026.05100092.3977.258.736565.55
RMU2026.051000100045.4486.3555.3
SAUCE2026.05100068.9859.5841.8937.6554.8
SLUG2026.0599.876.799.747.6598.481.4552.32
SLUG2026.0599.4718.4999.6714.9499.545.7556.31
HFRUvariant=Full, backbone=Qwen2.5-VL-3B-Instruct2026.0599.4795.1210094.9198.8895.3797.29
Qwen3-VL-4B-Instruct + HFRUunlearning_method=HFRU2026.0599.49498.5494.2599.3494.4196.66
HFRUvariant=Stage 2, backbone=Qwen2.5-VL-3B-Instruct2026.0599.0194.8799.694.1299.3394.6296.93
GD2026.0598.283.8136.3880.3512.391.4453.76
GA2026.0598.083.4836.8479.4812.4392.0153.72
SimNPO2026.0597.8269.6393.9265.5419.4499.0574.23
SimNPO2026.0597.8280.6893.6590.73100077.15
Qwen3-VL-4B-Instruct + Stage 2unlearning_stage=22026.0593.3295.5392.295.4199.1495.1295.12
HFRUvariant=Stage 1, backbone=Qwen2.5-VL-3B-Instruct2026.0578.4486.875.0786.1445.9781.0976.93
Qwen3-VL-4B-Instruct + Stage 1unlearning_stage=12026.0578.3190.3660.4590.4447.8691.4476.48
SAUCE2026.0563.9692.9359.5293.6771.3670.1375.26
UNDIAL2026.0563.2964.1553.1165.782.7897.6857.8
NPO2026.0537.1794.6237.2494.7519.2587.0561.68
Qwen2.5-VL-3B-Instructstatus=base model2026.0524.1486.7228.9785.5612.0491.7354.86
NPO2026.0517.0694.6616.794.5413.4391.3554.62
RMU2026.0513.8291.9714.0292.3930.0393.4655.95
Qwen3-VL-4B-Instruct2026.0512.1791.9711.7792.19.1393.5577.47
UNDIAL2026.0511.1889.6210.7889.3310.0593.2650.7