Contextual Question Answering on Gemma-2B-IT 5% forget set
92.4ROUGE-LPDU
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| PDUVariant=Context-aware2025.10 | 92.4 | 97.5 | |
| GradDiffVariant=Context-aware2025.10 | 86.8 | 94.5 | |
| SimNPOVariant=Context-aware2025.10 | 76.5 | 97 | |
| DPOVariant=Context-aware2025.10 | 74.9 | 85.5 | |
| SimNPOVariant=Vanilla2025.10 | 70.6 | 94 | |
| DPOVariant=Vanilla2025.10 | 40.5 | 55.5 | |
| PDUVariant=Vanilla2025.10 | 3 | 0 | |
| GradDiffVariant=Vanilla2025.10 | 0.1 | 0 |