List your company

Direct Question Answering on Gemma-2B-IT 5% forget set

47.1ROUGE-LSimNPO
-1.7810.9123.636.29Oct 20, 2025

Evaluation results

MethodLinks
SimNPOVariant=Context-aware2025.1047.135.5
SimNPOVariant=Vanilla2025.1046.937.5
DPOVariant=Context-aware2025.1023.719
DPOVariant=Vanilla2025.1018.413.5
PDUVariant=Context-aware2025.104.10
PDUVariant=Vanilla2025.102.50
GradDiffVariant=Vanilla2025.100.50
GradDiffVariant=Context-aware2025.100.10