Model Editing on CounterFact (Specific Editing Metrics and General Capabilities)
64.6Rel (QA Context)CrispEdit
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| CrispEditExecution=Sequential, Backbone=Qwen-2.5-1.5B-Instruct2026.02 | 64.6 | 41.8 | 6,030 | 2,790 | 58.4 | 39.9 | 47.7 | 43 | 58 | |
| CrispEditExecution=Batch, Backbone=Qwen-2.5-1.5B-Instruct2026.02 | 63.3 | 34.4 | 6,700 | 2,990 | 61.5 | 40.5 | 47.3 | 44 | 58.5 | |
| LocBF-FTBackbone=Qwen-2.5-1.5B-Instruct2026.02 | 58.2 | 32.6 | 4,680 | 2,150 | 59.3 | 39 | 46.6 | 40.5 | 56 | |
| AlphaEditBackbone=Qwen-2.5-1.5B-Instruct2026.02 | 22.6 | 14.1 | 3,120 | 1,680 | 24.4 | 12.9 | 46.8 | 19 | 1.5 | |
| FTBackbone=Qwen-2.5-1.5B-Instruct2026.02 | 22.3 | 28.4 | 890 | 1,420 | 34.8 | 15.1 | 45.7 | 23.5 | 6.5 | |
| UltraEditBackbone=Qwen-2.5-1.5B-Instruct2026.02 | 10.8 | 8.5 | 1,440 | 590 | 62.4 | 41.9 | 44.8 | 41.5 | 62 | |
| Adam-NSCLBackbone=Qwen-2.5-1.5B-Instruct2026.02 | 5.9 | 4.9 | 340 | 150 | 60.5 | 18.5 | 48.3 | 36 | 4.5 | |
| Qwen-2.5-1.5B-Instructstatus=Base Model (Unedited)2026.02 | 2 | 1.8 | 90 | 70 | 61.9 | 48.3 | 50.9 | 52 | 58 |