List your company
ResearchFormerly WizWand

Unlearning on TOFU (Split99)

1Forget QualityUNDIAL
-0.040.230.50.77Feb 27, 2026
Updated 5mo ago

Evaluation results

MethodLinks
UNDIALModel=Qwen2.5-1.5B-Instruct, Setting=Clean2026.02176.90.33812.3
GRADASCENTModel=Qwen2.5-1.5B-Instruct, Setting=MPU2026.020.99740.346-21.7
GRADDIFFModel=Qwen2.5-1.5B-Instruct, Setting=MPU2026.020.99740.346-21.6
DPOModel=Qwen2.5-1.5B-Instruct, Setting=MPU2026.020.9973.80.347-21.7
SIMNPOModel=Qwen2.5-1.5B-Instruct, Setting=MPU2026.020.9973.80.347-22
SATIMPModel=Qwen2.5-1.5B-Instruct, Setting=MPU2026.020.99740.346-21.5
NPOModel=Qwen2.5-1.5B-Instruct, Setting=MPU2026.020.91973.90.346-21.9
NPOModel=Llama-3.2-1B, Setting=MPU, noise level (κ)=0.12026.020.91961.80.59628.1
DPOModel=Qwen2.5-3B-Instruct, Setting=MPU2026.020.76670.90.397-28.8
NPOModel=Qwen2.5-3B-Instruct, Setting=MPU2026.020.76671.10.397-28.5
SIMNPOModel=Qwen2.5-3B-Instruct, Setting=MPU2026.020.766710.397-28.6
DPOModel=Llama-3.2-3B-Instruct, Setting=MPU2026.020.57968.30.633-3.95
GRADASCENTModel=Qwen2.5-3B-Instruct, Setting=MPU2026.020.57970.90.391-28.1
DPOModel=Qwen2.5-1.5B-Instruct, Setting=Clean2026.020.26675.70.30586
DPOModel=Llama-3.2-1B, Setting=MPU, noise level (κ)=0.052026.020.26664.10.594-29.2
SIMNPOModel=Llama-3.2-3B-Instruct, Setting=MPU2026.020.097155.40.656-64.3
GRADASCENTModel=Qwen2.5-1.5B-Instruct, Setting=Noised2026.020.054153.60.000762.1
GRADDIFFModel=Llama-3.2-3B-Instruct, Setting=MPU2026.020.054148.50.409107
GRADASCENTModel=Llama-3.2-1B, Setting=MPU, noise level (κ)=0.012026.020.054146.80.000269.6
SATIMPModel=Llama-3.2-3B-Instruct, Setting=MPU2026.020.028651.20.659-99.9
GRADASCENTModel=Qwen2.5-1.5B-Instruct, Setting=Clean2026.020.014351.60.00113.7
NPOModel=Qwen2.5-1.5B-Instruct, Setting=Clean2026.020.014370.80.30589.4
GRADASCENTModel=Llama-3.2-1B, Setting=MPU, noise level (κ)=02026.020.0068440.000167.9
GRADDIFFModel=Qwen2.5-1.5B-Instruct, Setting=Clean2026.020.000162.20.29780.9
GRADASCENTModel=Llama-3.2-3B-Instruct, Setting=Clean2026.02018.70.000150.6