Knowledge Editing on MMEdit E-IC
99.88ReliabilityLLaVA
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| LLaVA2026.05 | 99.88 | — | — | 41.3 | 6.22 | 86.14 | — | |
| ASAMBackbone=LLaVA2026.05 | 99.88 | — | — | 41.9 | 6.24 | 86.15 | — | |
| SERACBackbone=BLIP-2 OPT, Size=3.8B2024.09 | 99.7 | 98.9 | 89.2 | 95.7 | 7.5 | — | — | |
| UniKEBackbone=BLIP-2 OPT, Size=3.8B2024.09 | 98.3 | 96.3 | 93.2 | 95.8 | 85.7 | — | — | |
| DSCABase Model=LLaVA-1.5-7B2026.04 | 98 | 97.1 | — | 100 | 99.9 | 97.02 | 98 | |
| UniKEBackbone=MiniGPT-4, Size=7.3B2024.09 | 96.8 | 95.7 | 92.4 | 98.9 | 87.3 | — | — | |
| DualEditBase Model=LLaVA-1.5-7B2026.04 | 96.76 | 96.52 | — | 100 | 99.74 | 96.24 | 97.85 | |
| In-Context EditingBackbone=BLIP-2 OPT, Size=3.8B2024.09 | 96.7 | 78.2 | 87.6 | 49 | 3 | — | — | |
| KEBackbone=MiniGPT-4, Size=7.3B2024.09 | 96.6 | 67.8 | 57.4 | 97.3 | 64.4 | — | — | |
| MENDBackbone=MiniGPT-4, Size=7.3B2024.09 | 96.6 | 96.1 | 76.3 | 98.4 | 75.3 | — | — | |
| MENDBackbone=BLIP-2 OPT, Size=3.8B2024.09 | 96.1 | 95.8 | 74.2 | 94.5 | 70.8 | — | — | |
| VisEditBase Model=LLaVA-1.5-7B2026.04 | 95.06 | 94.87 | — | 100 | 95.23 | 94.35 | 95.9 | |
| MENDBase Model=LLaVA-1.5-7B2026.04 | 93.76 | 93.46 | — | 91.6 | 87.59 | 92.14 | 91.71 | |
| LTEBase Model=LLaVA-1.5-7B2026.04 | 93.6 | 92.38 | — | 85.54 | 88.49 | 91.18 | 90.24 | |
| SERACBackbone=MiniGPT-4, Size=7.3B2024.09 | 91.8 | 91.4 | 91 | 97.9 | 7.2 | — | — | |
| In-Context EditingBackbone=MiniGPT-4, Size=7.3B2024.09 | 90.9 | 81.6 | 88.5 | 52.2 | 4.7 | — | — | |
| ASAMBackbone=Qwen2VL2026.05 | 87.24 | — | — | 29.62 | 5.31 | 72.34 | — | |
| Qwen2VL2026.05 | 86.94 | — | — | 28.66 | 5.26 | 72.27 | — | |
| T-PatcherBackbone=BLIP-2 OPT, Size=3.8B2024.09 | 85.6 | 73.4 | 70 | 91.1 | 82 | — | — | |
| T-PatcherBackbone=MiniGPT-4, Size=7.3B2024.09 | 83.8 | 72.3 | 67.7 | 93.9 | 83.6 | — | — | |
| FT (last layer)Backbone=MiniGPT-4, Size=7.3B2024.09 | 67.4 | 65.1 | 62.8 | 63.5 | 52.7 | — | — | |
| FT (last layer)Backbone=BLIP-2 OPT, Size=3.8B2024.09 | 61.1 | 52.1 | 51.6 | 55 | 49.5 | — | — | |
| KEBackbone=BLIP-2 OPT, Size=3.8B2024.09 | 50.5 | 49 | 46.3 | 95 | 64.3 | — | — | |
| SERACBase Model=LLaVA-1.5-7B2026.04 | 43.08 | 42.37 | — | 100 | 7.63 | 42.85 | 47.19 | |
| Backbone ModelBackbone=BLIP-2 OPT, Size=3.8B2024.09 | 0 | 0 | 0 | 100 | 100 | — | — | |
| Base ModelBackbone=MiniGPT-4, Size=7.3B2024.09 | 0 | 0 | 0 | 100 | 100 | — | — |