Contextual Question Answering on 5% (forget set)
91ROUGE-LRMU
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RMUModel=Gemma-2B-IT, Variant=Context-aware2025.10 | 91 | 99 | |
| NPOModel=Gemma-2B-IT, Variant=Context-aware2025.10 | 87 | 98 | |
| UNDIALModel=Gemma-2B-IT, Variant=Context-aware2025.10 | 87 | 98 | |
| UNDIALModel=Qwen3-8B, Variant=Context-aware2025.10 | 68 | 98 | |
| RMUModel=Qwen3-8B, Variant=Context-aware2025.10 | 67 | 97 | |
| NPOModel=Qwen3-8B, Variant=Context-aware2025.10 | 63 | 95 | |
| UNDIALModel=Qwen3-8B, Variant=Vanilla2025.10 | 59 | 97 | |
| NPOModel=Gemma-2B-IT, Variant=Vanilla2025.10 | 55 | 81 | |
| UNDIALModel=Gemma-2B-IT, Variant=Vanilla2025.10 | 53 | 82 | |
| NPOModel=Qwen3-8B, Variant=Vanilla2025.10 | 46 | 84 | |
| RMUModel=Qwen3-8B, Variant=Vanilla2025.10 | 18 | 5 | |
| RMUModel=Gemma-2B-IT, Variant=Vanilla2025.10 | 1 | 0 |