Knowledge Unlearning on MUSE books
58.4Verbosity ScoreOriginal
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Original# Tokens Df=0%, # Tokens Dr=0%2026.06 | 58.4 | 63.9 | — | — | — | 55.2 | |
| SimNPO + KLR# Tokens Df=100%, # Tokens Dr=100%2026.06 | 47.4 | 46.2 | 94.6 | 61.2 | 82.4 | 67.3 | |
| NPO + GDR# Tokens Df=100%, # Tokens Dr=100%2026.06 | 21.1 | 32.5 | 94 | 58.2 | 78 | 62.4 | |
| NPO# Tokens Df=100%, # Tokens Dr=0%2026.06 | 11.9 | 4.7 | 94.4 | 58.6 | 80 | 5.9 | |
| NPO + KLR# Tokens Df=100%, # Tokens Dr=100%2026.06 | 8 | 45.4 | 94.6 | 60.4 | 81.4 | 67.3 | |
| SimNPO + GDR# Tokens Df=100%, # Tokens Dr=100%2026.06 | 0.6 | 23.4 | 95.2 | 59.6 | 81.2 | 64.8 | |
| GA# Tokens Df=100%, # Tokens Dr=0%2026.06 | 0 | 0 | 94 | 63 | 77.6 | 0 | |
| GA + GDR# Tokens Df=100%, # Tokens Dr=100%2026.06 | 0 | 0 | 94 | 60 | 79.6 | 10.9 | |
| GA + KLR# Tokens Df=100%, # Tokens Dr=100%2026.06 | 0 | 0 | 94 | 61.6 | 80 | 40.5 | |
| SimNPO# Tokens Df=100%, # Tokens Dr=0%2026.06 | 0 | 0 | 93.8 | 60.2 | 80.6 | 0 | |
| RULE GRPO# Tokens Df=2.9%, # Tokens Dr=2.9%2026.06 | 0 | 1.4 | 99.2 | 38.2 | 90.8 | 46.3 | |
| ReRULE GRPO# Tokens Df=2.9%, # Tokens Dr=2.9%2026.06 | 0 | 1.4 | 98.8 | 28.7 | 93 | 56.2 |