Knowledge Unlearning on GONE Wikidata (QA Templates)
100Direct Success RateICU
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| ICUBackbone=LLAMA-3-8B-Instruct2026.02 | 100 | 98.4 | 67.9 | 95 | 27.3 | 71.5 | |
| NEDSBackbone=LLAMA-3-8B-Instruct2026.02 | 100 | 100 | 72.5 | 100 | 69.8 | 0 | |
| NEDSModel=Mistral-7B-Instruct-v0.2, Template=QA2026.02 | 100 | 100 | 56.2 | 99.9 | 83.9 | 0 | |
| NPOModel=Mistral-7B-Instruct-v0.2, Template=QA2026.02 | 99.2 | 99.5 | 73 | 99.8 | 71.7 | 0 | |
| GAModel=Mistral-7B-Instruct-v0.2, Template=QA2026.02 | 98.5 | 97.1 | 32.2 | 77.8 | 83.4 | 0 | |
| ICUModel=Mistral-7B-Instruct-v0.2, Template=QA2026.02 | 98.1 | 98.6 | 53.2 | 96.7 | 60.6 | 7.7 | |
| UL-DPOModel=Mistral-7B-Instruct-v0.2, Template=QA2026.02 | 83.3 | 79 | 59.8 | 89.9 | 72.5 | 49.9 | |
| AlphaEditModel=Mistral-7B-Instruct-v0.2, Template=QA2026.02 | 83.1 | 77.9 | 42.5 | 84.5 | 36.9 | 24 | |
| WiseModel=Mistral-7B-Instruct-v0.2, Template=QA2026.02 | 75.8 | 77.5 | 69.7 | 53.9 | 22.2 | 24.4 | |
| NPOBackbone=LLAMA-3-8B-Instruct2026.02 | 63.5 | 59.5 | 20.9 | 40.6 | 93.8 | 0 | |
| UL-DPOBackbone=LLAMA-3-8B-Instruct2026.02 | 62.8 | 58.1 | 36.6 | 38 | 78.3 | 11 | |
| AlphaEditBackbone=LLAMA-3-8B-Instruct2026.02 | 48.7 | 46.2 | 28.9 | 34.8 | 51.4 | 22.5 | |
| GDModel=Mistral-7B-Instruct-v0.2, Template=QA2026.02 | 39.9 | 41.7 | 53.6 | 64.3 | 60.8 | 0.1 | |
| WiseBackbone=LLAMA-3-8B-Instruct2026.02 | 32.4 | 37.1 | 44.5 | 22.9 | 59.1 | 9.7 | |
| BE (before)Model=Mistral-7B-Instruct-v0.2, Template=QA2026.02 | 25.3 | 25.7 | 36.4 | 58.2 | 65.3 | 0 | |
| GABackbone=LLAMA-3-8B-Instruct2026.02 | 23.5 | 27.9 | 23.6 | 15.5 | 74.6 | 0 | |
| GDBackbone=LLAMA-3-8B-Instruct2026.02 | 13.4 | 16.4 | 14.2 | 13.9 | 90.8 | 0 | |
| BE (before)Backbone=LLAMA-3-8B-Instruct2026.02 | 7.4 | 10.6 | 9.6 | 11.2 | 72.8 | 0 |