Sequential Model Editing on ZsRE (T = 10000)
96.6EfficacyBetaEdit
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BetaEditBackbone=LLaMA3-8B-Instruct2026.05 | 96.6 | 92.4 | 43.9 | |
| MEMITBackbone=LLaMA3-8B-Instruct2026.05 | 93.2 | 89.3 | 44.2 | |
| BetaEditBackbone=GPT-J-6B2026.05 | 92.5 | 86.5 | 24.7 | |
| BetaEditBackbone=Qwen3-4B-Instruct2026.05 | 92.1 | 84 | 37 | |
| MEMITBackbone=Qwen3-4B-Instruct2026.05 | 90 | 81.2 | 36.3 | |
| AlphaEditBackbone=GPT-J-6B2026.05 | 88.3 | 83.1 | 22.8 | |
| EMMETBackbone=GPT-J-6B2026.05 | 87.5 | 82.6 | 22.8 | |
| PMETBackbone=LLaMA3-8B-Instruct2026.05 | 80.1 | 74.3 | 37.5 | |
| Pre-editedBackbone=LLaMA3-8B-Instruct2026.05 | 37.8 | 37.4 | 37.2 | |
| Pre-editedBackbone=Qwen3-4B-Instruct2026.05 | 32.1 | 32.2 | 34.8 | |
| Pre-editedBackbone=GPT-J-6B2026.05 | 27.8 | 26.5 | 26 |