Model Utility Preservation on Model Utility (retain set)
61UtilityNPO
Evaluation results
| Method | Links | |
|---|---|---|
| NPOModel=Qwen3-8B, Variant=Context-aware2025.10 | 61 | |
| UNDIALModel=Qwen3-8B, Variant=Context-aware2025.10 | 61 | |
| RMUModel=Gemma-2B-IT, Variant=Vanilla2025.10 | 60 | |
| NPOModel=Qwen3-8B, Variant=Vanilla2025.10 | 60 | |
| UNDIALModel=Qwen3-8B, Variant=Vanilla2025.10 | 60 | |
| RMUModel=Qwen3-8B, Variant=Vanilla2025.10 | 59 | |
| NPOModel=Gemma-2B-IT, Variant=Vanilla2025.10 | 57 | |
| NPOModel=Gemma-2B-IT, Variant=Context-aware2025.10 | 57 | |
| RMUModel=Gemma-2B-IT, Variant=Context-aware2025.10 | 57 | |
| RMUModel=Qwen3-8B, Variant=Context-aware2025.10 | 57 | |
| UNDIALModel=Gemma-2B-IT, Variant=Context-aware2025.10 | 55 | |
| UNDIALModel=Gemma-2B-IT, Variant=Vanilla2025.10 | 54 |