Medical Summarization on MeQSum
29.44MeQSum ScoreEU
Evaluation Results
| Method | Links | |
|---|---|---|
| EUBackbone=OLMo-2-1B-Instruct, Lambda (λ)=0.952026.04 | 29.44 | |
| EUBackbone=OLMo-2-7B-Instruct, Lambda (λ)=0.62026.04 | 28.68 | |
| RetainOnlyFTBackbone=OLMo-2-1B-Instruct2026.04 | 28.32 | |
| UnlearningBackbone=OLMo-2-1B-Instruct, Lambda (λ)=0.952026.04 | 27.56 | |
| UnlearningBackbone=Llama-3.2-1B-Instruct, Lambda (λ)=0.62026.04 | 26.39 | |
| RetainOnlyFTBackbone=OLMo-2-7B-Instruct2026.04 | 25.87 | |
| RetainOnlyFTBackbone=Llama-3.2-1B-Instruct2026.04 | 25.82 | |
| DPOBackbone=Llama-3.2-1B-Instruct2026.04 | 24.77 | |
| OLMo-2-7B-InstructBackbone=OLMo-2-7B-Instruct2026.04 | 24.49 | |
| EraserBackbone=OLMo-2-1B-Instruct, Lambda (λ)=0.952026.04 | 24.17 | |
| EraserBackbone=OLMo-2-7B-Instruct, Lambda (λ)=0.62026.04 | 23.98 | |
| EUBackbone=Llama-3.2-1B-Instruct, Lambda (λ)=0.62026.04 | 23.97 | |
| RetainOnlyFTBackbone=Llama-3.2-3B-Instruct2026.04 | 23.94 | |
| UnlearningBackbone=OLMo-2-7B-Instruct, Lambda (λ)=0.62026.04 | 23.67 | |
| UnlearningBackbone=Llama-3.2-3B-Instruct, Lambda (λ)=0.62026.04 | 20.83 | |
| EUBackbone=Llama-3.2-3B-Instruct, Lambda (λ)=0.62026.04 | 20.15 | |
| EraserBackbone=Llama-3.2-3B-Instruct, Lambda (λ)=0.62026.04 | 19.19 | |
| DPOBackbone=OLMo-2-7B-Instruct2026.04 | 18.41 | |
| EraserBackbone=Llama-3.2-1B-Instruct, Lambda (λ)=0.62026.04 | 17.54 | |
| DPOBackbone=OLMo-2-1B-Instruct2026.04 | 15.24 | |
| DPOBackbone=Llama-3.2-3B-Instruct2026.04 | 15.04 | |
| OLMo-2-1B-InstructBackbone=OLMo-2-1B-Instruct2026.04 | 14.75 | |
| SKUBackbone=OLMo-2-7B-Instruct2026.04 | 13.33 | |
| Llama-3.2-1B-InstructBackbone=Llama-3.2-1B-Instruct2026.04 | 11.92 | |
| SKUBackbone=Llama-3.2-1B-Instruct2026.04 | 11.22 | |
| SKUBackbone=Llama-3.2-3B-Instruct2026.04 | 10.79 | |
| SKUBackbone=OLMo-2-1B-Instruct2026.04 | 10.79 | |
| Llama-3.2-3B-InstructBackbone=Llama-3.2-3B-Instruct2026.04 | 8.63 |