ResearchBenchmarksDirect Question Answering on Gemma-2B-IT 5% forget setFollow47.1ROUGE-LSimNPO-1.7810.9123.636.29Oct 20, 2025Evaluation ResultsMethodMethodLinksROUGE-LLLM Judge ScoreSimNPOVariant=Context-awareVariant=Context-aware2025.1047.135.5SimNPOVariant=VanillaVariant=Vanilla2025.1046.937.5DPOVariant=Context-awareVariant=Context-aware2025.1023.719DPOVariant=VanillaVariant=Vanilla2025.1018.413.5PDUVariant=Context-awareVariant=Context-aware2025.104.10PDUVariant=VanillaVariant=Vanilla2025.102.50GradDiffVariant=VanillaVariant=Vanilla2025.100.50GradDiffVariant=Context-awareVariant=Context-aware2025.100.10