Structural Erasure on MUSE
1.979CADSimNPO
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| SimNPOModel=Llama-3.1-8B-Instruct2026.05 | 1.979 | 1.979 | 1.104 | |
| MANSUModel=Llama-3.1-8B-Instruct2026.05 | 1.671 | 0.318 | 0.097 | |
| Global GAModel=Llama-3.1-8B-Instruct2026.05 | 1.66 | 1.66 | 1.187 | |
| NPOModel=Llama-3.1-8B-Instruct2026.05 | 1.635 | 1.635 | 1.15 | |
| Surgical GAModel=Llama-3.1-8B-Instruct2026.05 | 1.599 | 1.599 | 0.469 | |
| GU+SimNPOModel=Llama-3.1-8B-Instruct2026.05 | 1.522 | 1.522 | 1.256 | |
| SimNPOModel=Qwen-3-8B2026.05 | 1.299 | 1.299 | 0.828 | |
| NPOModel=Qwen-3-8B2026.05 | 1.23 | 1.23 | 0.77 | |
| MANSUModel=Qwen-3-8B2026.05 | 1.143 | 0.441 | 0.182 | |
| GU+SimNPOModel=Qwen-3-8B2026.05 | 1.112 | 1.112 | 0.757 | |
| Global GAModel=Qwen-3-8B2026.05 | 1.106 | 1.106 | 0.721 | |
| Surgical GAModel=Qwen-3-8B2026.05 | 1.09 | 1.09 | 0.568 | |
| LUNARModel=Llama-3.1-8B-Instruct2026.05 | 0.045 | 1.248 | 0.328 | |
| LUNARModel=Qwen-3-8B2026.05 | 0.043 | 1.201 | 0.316 | |
| Zero-shotModel=Llama-3.1-8B-Instruct2026.05 | 0 | 0 | 0 | |
| Zero-shotModel=Qwen-3-8B2026.05 | 0 | 0 | 0 |