Mathematical Reasoning on MathQA (Retention)
25.19RetentionUnlearning
Evaluation Results
| Method | Links | |
|---|---|---|
| UnlearningModel=OLMo-2-7B-Instruct, Hyperparameter (λ)=0.62026.04 | 25.19 | |
| DPOModel=OLMo-2-7B-Instruct2026.04 | 25.03 | |
| EraserModel=Llama-3.2-3B-Instruct, Hyperparameter (λ)=0.62026.04 | 24.89 | |
| EUModel=Llama-3.2-3B-Instruct, Hyperparameter (λ)=0.62026.04 | 24.76 | |
| OLMo-2-7B-InstructModel=OLMo-2-7B-Instruct2026.04 | 24.69 | |
| Llama-3.2-3B-InstructModel=Llama-3.2-3B-Instruct2026.04 | 24.66 | |
| RetainOnlyFTModel=Llama-3.2-3B-Instruct2026.04 | 24.56 | |
| RetainOnlyFTModel=OLMo-2-7B-Instruct2026.04 | 24.42 | |
| UnlearningModel=Llama-3.2-3B-Instruct, Hyperparameter (λ)=0.62026.04 | 24.29 | |
| EUModel=OLMo-2-7B-Instruct, Hyperparameter (λ)=0.62026.04 | 24.22 | |
| DPOModel=Llama-3.2-3B-Instruct2026.04 | 24.19 | |
| SKUModel=OLMo-2-7B-Instruct2026.04 | 24.19 | |
| EraserModel=OLMo-2-1B-Instruct, Hyperparameter (λ)=0.62026.04 | 24.15 | |
| DPOModel=OLMo-2-1B-Instruct2026.04 | 24.09 | |
| EUModel=OLMo-2-1B-Instruct, Hyperparameter (λ)=0.62026.04 | 24.02 | |
| EraserModel=OLMo-2-7B-Instruct, Hyperparameter (λ)=0.62026.04 | 23.72 | |
| DPOModel=Llama-3.2-1B-Instruct2026.04 | 23.45 | |
| OLMo-2-1B-InstructModel=OLMo-2-1B-Instruct2026.04 | 23.45 | |
| SKUModel=Llama-3.2-3B-Instruct2026.04 | 23.42 | |
| RetainOnlyFTModel=OLMo-2-1B-Instruct2026.04 | 23.35 | |
| UnlearningModel=OLMo-2-1B-Instruct, Hyperparameter (λ)=0.62026.04 | 23.25 | |
| UnlearningModel=Llama-3.2-1B-Instruct, Hyperparameter (λ)=0.62026.04 | 23.22 | |
| SKUModel=OLMo-2-1B-Instruct2026.04 | 23.18 | |
| Llama-3.2-1B-InstructModel=Llama-3.2-1B-Instruct2026.04 | 22.68 | |
| RetainOnlyFTModel=Llama-3.2-1B-Instruct2026.04 | 22.68 | |
| SKUModel=Llama-3.2-1B-Instruct2026.04 | 22.28 | |
| EraserModel=Llama-3.2-1B-Instruct, Hyperparameter (λ)=0.62026.04 | 22.11 | |
| EUModel=Llama-3.2-1B-Instruct, Hyperparameter (λ)=0.62026.04 | 21.98 |