Mathematical Reasoning on GSM8K (Retention)
73.39RetentionDPO
Evaluation results
| Method | Links | |
|---|---|---|
| DPOModel=OLMo-2-7B-Instruct2026.04 | 73.39 | |
| RetainOnlyFTModel=OLMo-2-7B-Instruct2026.04 | 72.48 | |
| EraserModel=OLMo-2-7B-Instruct, Hyperparameter (λ)=0.62026.04 | 72.18 | |
| SKUModel=OLMo-2-7B-Instruct2026.04 | 72.02 | |
| EUModel=OLMo-2-7B-Instruct, Hyperparameter (λ)=0.62026.04 | 71.49 | |
| OLMo-2-7B-InstructModel=OLMo-2-7B-Instruct2026.04 | 71.27 | |
| UnlearningModel=OLMo-2-7B-Instruct, Hyperparameter (λ)=0.62026.04 | 69.14 | |
| RetainOnlyFTModel=Llama-3.2-3B-Instruct2026.04 | 66.34 | |
| EraserModel=Llama-3.2-3B-Instruct, Hyperparameter (λ)=0.62026.04 | 66.19 | |
| UnlearningModel=Llama-3.2-3B-Instruct, Hyperparameter (λ)=0.62026.04 | 62.47 | |
| EUModel=Llama-3.2-3B-Instruct, Hyperparameter (λ)=0.62026.04 | 60.35 | |
| DPOModel=OLMo-2-1B-Instruct2026.04 | 57.16 | |
| EraserModel=OLMo-2-1B-Instruct, Hyperparameter (λ)=0.62026.04 | 53.75 | |
| SKUModel=OLMo-2-1B-Instruct2026.04 | 52.31 | |
| EUModel=OLMo-2-1B-Instruct, Hyperparameter (λ)=0.62026.04 | 51.1 | |
| UnlearningModel=OLMo-2-1B-Instruct, Hyperparameter (λ)=0.62026.04 | 51.09 | |
| RetainOnlyFTModel=OLMo-2-1B-Instruct2026.04 | 50.49 | |
| EUModel=Llama-3.2-1B-Instruct, Hyperparameter (λ)=0.62026.04 | 42.68 | |
| OLMo-2-1B-InstructModel=OLMo-2-1B-Instruct2026.04 | 42.68 | |
| UnlearningModel=Llama-3.2-1B-Instruct, Hyperparameter (λ)=0.62026.04 | 42.08 | |
| EraserModel=Llama-3.2-1B-Instruct, Hyperparameter (λ)=0.62026.04 | 41.32 | |
| RetainOnlyFTModel=Llama-3.2-1B-Instruct2026.04 | 41.17 | |
| SKUModel=Llama-3.2-3B-Instruct2026.04 | 34.65 | |
| DPOModel=Llama-3.2-1B-Instruct2026.04 | 33.13 | |
| SKUModel=Llama-3.2-1B-Instruct2026.04 | 30.55 | |
| Llama-3.2-3B-InstructModel=Llama-3.2-3B-Instruct2026.04 | 18.5 | |
| DPOModel=Llama-3.2-3B-Instruct2026.04 | 17.06 | |
| Llama-3.2-1B-InstructModel=Llama-3.2-1B-Instruct2026.04 | 13.12 |