Online Multimodal Model Editing on E-IC
100T-Gen (Text Generation Fidelity)FT-M
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| FT-MModel=BLIP2-OPT, Edit Horizon=1, Parameter-modifying=true2026.05 | 100 | 100 | 76.92 | 100 | 24.79 | 80.34 | — | |
| MENDModel=BLIP2-OPT, Edit Horizon=1, Parameter-modifying=true2026.05 | 100 | 100 | 100 | 84.21 | 100 | 96.84 | — | |
| IKEModel=BLIP2-OPT, Edit Horizon=1, Parameter-modifying=false2026.05 | 100 | 100 | 100 | 63.16 | 10 | 74.63 | — | |
| M-OREModel=BLIP2-OPT, Edit Horizon=1, Parameter-modifying=false2026.05 | 100 | 100 | 93.75 | 100 | 100 | 98.75 | — | |
| FT-LModel=LLaVA-v1.5, Edit Horizon=1, Parameter-modifying=true2026.05 | 100 | 100 | 89.8 | 91.67 | 28.01 | 81.89 | — | |
| FT-MModel=LLaVA-v1.5, Edit Horizon=1, Parameter-modifying=true2026.05 | 100 | 100 | 76.47 | 100 | 26.11 | 80.52 | — | |
| M-OREModel=LLaVA-v1.5, Edit Horizon=1, Parameter-modifying=false2026.05 | 100 | 100 | 94.12 | 100 | 100 | 98.82 | — | |
| FT-MModel=BLIP2-OPT (2.7B), Number of online edits=12026.07 | 100 | — | 76.92 | 100 | 24.79 | 80.34 | 100 | |
| MENDModel=BLIP2-OPT (2.7B), Number of online edits=12026.07 | 100 | — | 100 | 84.21 | 100 | 96.84 | 100 | |
| M-OREModel=BLIP2-OPT (2.7B), Number of online edits=12026.07 | 100 | — | 84.62 | 100 | 100 | 97.44 | 100 | |
| IKEModel=BLIP2-OPT (2.7B), Number of online edits=12026.07 | 100 | — | 100 | 63.16 | 10 | 74.63 | 100 | |
| ScopeEditModel=BLIP2-OPT (2.7B), Number of online edits=12026.07 | 100 | — | 92.31 | 100 | 100 | 98.72 | 100 | |
| FT-LModel=LLaVA-v1.5 (7B), Number of online edits=12026.07 | 100 | — | 89.8 | 91.67 | 28.01 | 81.89 | 100 | |
| FT-MModel=LLaVA-v1.5 (7B), Number of online edits=12026.07 | 100 | — | 76.47 | 100 | 26.11 | 80.52 | 100 | |
| M-OREModel=LLaVA-v1.5 (7B), Number of online edits=12026.07 | 100 | — | 88.24 | 100 | 100 | 98.04 | 100 | |
| ScopeEditModel=LLaVA-v1.5 (7B), Number of online edits=12026.07 | 100 | — | 94.12 | 100 | 100 | 99.02 | 100 | |
| M-OREModel=Qwen2-VL, Edit Horizon=12026.07 | 100 | 100 | 90.82 | 100 | 100 | — | — | |
| ScopeEditModel=Qwen2-VL, Edit Horizon=12026.07 | 100 | 100 | 100 | 100 | 100 | — | — | |
| M-OREModel=Qwen3-VL, Edit Horizon=12026.07 | 100 | 100 | 92.31 | 100 | 100 | — | — | |
| ScopeEditModel=Qwen3-VL, Edit Horizon=12026.07 | 100 | 100 | 92.31 | 100 | 100 | — | — | |
| MENDModel=LLaVA-v1.5, Edit Horizon=1, Parameter-modifying=true2026.05 | 97.65 | 96.81 | 96.44 | 94.74 | 100 | 97.13 | — | |
| MENDModel=LLaVA-v1.5 (7B), Number of online edits=12026.07 | 97.65 | — | 96.44 | 94.74 | 100 | 97.13 | 96.81 | |
| SERACModel=BLIP2-OPT, Edit Horizon=1, Parameter-modifying=false2026.05 | 95.52 | 97.38 | 86.11 | 100 | 63.82 | 88.57 | — | |
| SERACModel=BLIP2-OPT (2.7B), Number of online edits=12026.07 | 95.52 | — | 86.11 | 100 | 63.82 | 88.57 | 97.38 | |
| M-OREModel=Qwen2-VL, Edit Horizon=102026.07 | 95.18 | 96.01 | 85.85 | 97.52 | 95 | — | — | |
| FT-LModel=BLIP2-OPT, Edit Horizon=1, Parameter-modifying=true2026.05 | 95.02 | 96.77 | 90.72 | 90.05 | 68.27 | 88.16 | — | |
| FT-LModel=BLIP2-OPT (2.7B), Number of online edits=12026.07 | 95.02 | — | 90.72 | 90.05 | 68.27 | 88.16 | 96.77 | |
| ScopeEditModel=LLaVA-v1.5 (7B), Number of online edits=1002026.07 | 94.66 | — | 86.35 | 98.42 | 92.26 | 93.42 | 95.42 | |
| IKEModel=LLaVA-v1.5, Edit Horizon=1, Parameter-modifying=false2026.05 | 94.12 | 94.12 | 94.12 | 62.5 | 12.5 | 71.47 | — | |
| IKEModel=LLaVA-v1.5 (7B), Number of online edits=12026.07 | 94.12 | — | 94.12 | 62.5 | 12.5 | 71.47 | 94.12 | |
| M-OREModel=LLaVA-v1.5 (7B), Number of online edits=1002026.07 | 93.47 | — | 78.29 | 97.48 | 89.21 | 90.61 | 94.58 | |
| M-OREModel=Qwen3-VL, Edit Horizon=102026.07 | 93.43 | 94.2 | 82.57 | 91.28 | 95 | — | — | |
| M-OREModel=LLaVA-v1.5, Edit Horizon=100, Parameter-modifying=false2026.05 | 93.27 | 94.64 | 78.66 | 97.39 | 89.71 | 90.73 | — | |
| ScopeEditModel=Qwen2-VL, Edit Horizon=102026.07 | 92.5 | 95.1 | 90.75 | 97.83 | 96.67 | — | — | |
| M-OREModel=Qwen3-VL, Edit Horizon=1002026.07 | 91.8 | 93.89 | 65.38 | 89.7 | 87.78 | — | — | |
| ScopeEditModel=BLIP2-OPT (2.7B), Number of online edits=1002026.07 | 91.75 | — | 85.48 | 97.63 | 97.17 | 93.01 | 93.01 | |
| ScopeEditModel=Qwen3-VL, Edit Horizon=102026.07 | 91.68 | 94.97 | 84.8 | 94.97 | 100 | — | — | |
| ScopeEditModel=Qwen2-VL, Edit Horizon=1002026.07 | 91.4 | 92.11 | 77.96 | 89.37 | 86.11 | — | — | |
| M-OREModel=Qwen2-VL, Edit Horizon=1002026.07 | 91.01 | 91.73 | 72.98 | 87.42 | 88.92 | — | — | |
| SERACModel=LLaVA-v1.5, Edit Horizon=1, Parameter-modifying=false2026.05 | 90.17 | 88.61 | 81.45 | 98.24 | 50.83 | 81.86 | — | |
| SERACModel=LLaVA-v1.5 (7B), Number of online edits=12026.07 | 90.17 | — | 81.45 | 98.24 | 50.83 | 81.86 | 88.61 | |
| M-OREModel=BLIP2-OPT (2.7B), Number of online edits=1002026.07 | 87.75 | — | 66.31 | 97.21 | 94.97 | 87.28 | 90.14 | |
| ScopeEditModel=Qwen3-VL, Edit Horizon=1002026.07 | 86.98 | 91.16 | 73.75 | 91.64 | 89.3 | — | — | |
| LiveEditModel=LLaVA-v1.5, Edit Horizon=1, Parameter-modifying=false2026.05 | 82.33 | 82.33 | 80.67 | 100 | 100 | 89.07 | — | |
| LiveEditModel=LLaVA-v1.5 (7B), Number of online edits=12026.07 | 82.33 | — | 80.67 | 100 | 100 | 89.07 | 82.33 | |
| FT-LModel=LLaVA-v1.5, Edit Horizon=100, Parameter-modifying=true2026.05 | 82.11 | 86 | 78.15 | 77.13 | 11.33 | 66.94 | — | |
| FT-LModel=LLaVA-v1.5 (7B), Number of online edits=1002026.07 | 82.11 | — | 78.15 | 77.13 | 11.33 | 66.94 | 86 | |
| LiveEditModel=BLIP2-OPT, Edit Horizon=1, Parameter-modifying=false2026.05 | 80.67 | 80.67 | 77.79 | 100 | 98.09 | 87.44 | — | |
| LiveEditModel=BLIP2-OPT (2.7B), Number of online edits=12026.07 | 80.67 | — | 77.79 | 100 | 98.09 | 87.44 | 80.67 | |
| FT-MModel=LLaVA-v1.5, Edit Horizon=100, Parameter-modifying=true2026.05 | 80.05 | 84.57 | 62.88 | 100 | 8.32 | 67.16 | — | |
| FT-MModel=LLaVA-v1.5 (7B), Number of online edits=1002026.07 | 80.05 | — | 62.88 | 100 | 8.32 | 67.16 | 84.57 | |
| LiveEditModel=LLaVA-v1.5, Edit Horizon=100, Parameter-modifying=false2026.05 | 78.77 | 78.49 | 65.5 | 98.77 | 96.76 | 83.66 | — | |
| LiveEditModel=LLaVA-v1.5 (7B), Number of online edits=1002026.07 | 78.77 | — | 65.5 | 98.77 | 96.76 | 83.66 | 78.49 | |
| M-OREModel=BLIP2-OPT, Edit Horizon=100, Parameter-modifying=false2026.05 | 78.17 | 83.14 | 60.08 | 95.51 | 95.58 | 82.49 | — | |
| IKEModel=LLaVA-v1.5, Edit Horizon=100, Parameter-modifying=false2026.05 | 77.37 | 78.78 | 78.07 | 53.86 | 12.88 | 60.19 | — | |
| IKEModel=LLaVA-v1.5 (7B), Number of online edits=1002026.07 | 77.37 | — | 78.07 | 53.86 | 12.88 | 60.19 | 78.78 | |
| LiveEditModel=BLIP2-OPT, Edit Horizon=100, Parameter-modifying=false2026.05 | 74.33 | 74.63 | 61.95 | 96.77 | 95.34 | 80.6 | — | |
| LiveEditModel=BLIP2-OPT (2.7B), Number of online edits=1002026.07 | 74.33 | — | 61.95 | 96.77 | 95.34 | 80.6 | 74.63 | |
| FT-LModel=BLIP2-OPT, Edit Horizon=100, Parameter-modifying=true2026.05 | 71.69 | 79.45 | 57.82 | 92.23 | 55.18 | 71.27 | — | |
| FT-LModel=BLIP2-OPT (2.7B), Number of online edits=1002026.07 | 71.69 | — | 57.82 | 92.23 | 55.18 | 71.27 | 79.45 | |
| IKEModel=BLIP2-OPT, Edit Horizon=100, Parameter-modifying=false2026.05 | 71.13 | 81.18 | 84.3 | 79.9 | 11.93 | 65.69 | — | |
| IKEModel=BLIP2-OPT (2.7B), Number of online edits=1002026.07 | 71.13 | — | 84.3 | 79.9 | 11.93 | 65.69 | 81.18 | |
| SERACModel=LLaVA-v1.5, Edit Horizon=100, Parameter-modifying=false2026.05 | 71 | 73.38 | 59.72 | 72.88 | 25.85 | 60.57 | — | |
| SERACModel=LLaVA-v1.5 (7B), Number of online edits=1002026.07 | 71 | — | 59.72 | 72.88 | 25.85 | 60.57 | 73.38 | |
| SERACModel=BLIP2-OPT, Edit Horizon=100, Parameter-modifying=false2026.05 | 63.79 | 74.02 | 56.93 | 77.52 | 42.94 | 63.04 | — | |
| SERACModel=BLIP2-OPT (2.7B), Number of online edits=1002026.07 | 63.79 | — | 56.93 | 77.52 | 42.94 | 63.04 | 74.02 | |
| FT-MModel=BLIP2-OPT, Edit Horizon=100, Parameter-modifying=true2026.05 | 62.17 | 67.18 | 51.63 | 100 | 9.81 | 58.16 | — | |
| FT-MModel=BLIP2-OPT (2.7B), Number of online edits=1002026.07 | 62.17 | — | 51.63 | 100 | 9.81 | 58.16 | 67.18 | |
| AlphaEditModel=LLaVA-v1.5, Edit Horizon=100, Parameter-modifying=true2026.05 | 48.21 | 51.98 | 47.23 | 92.59 | 56.9 | 59.38 | — | |
| AlphaEditModel=LLaVA-v1.5 (7B), Number of online edits=1002026.07 | 48.21 | — | 47.23 | 92.59 | 56.9 | 59.38 | 51.98 | |
| AlphaEditModel=LLaVA-v1.5, Edit Horizon=1, Parameter-modifying=true2026.05 | 47.06 | 47.06 | 52.94 | 100 | 100 | 69.41 | — | |
| AlphaEditModel=LLaVA-v1.5 (7B), Number of online edits=12026.07 | 47.06 | — | 52.94 | 100 | 100 | 69.41 | 47.06 | |
| AlphaEditModel=BLIP2-OPT, Edit Horizon=1, Parameter-modifying=true2026.05 | 30.77 | 30.77 | 30.77 | 89.47 | 100 | 56.35 | — | |
| AlphaEditModel=BLIP2-OPT (2.7B), Number of online edits=12026.07 | 30.77 | — | 30.77 | 89.47 | 100 | 56.35 | 30.77 | |
| AlphaEditModel=BLIP2-OPT, Edit Horizon=100, Parameter-modifying=true2026.05 | 28.57 | 27.94 | 26.69 | 90.52 | 78.83 | 50.51 | — | |
| AlphaEditModel=BLIP2-OPT (2.7B), Number of online edits=1002026.07 | 28.57 | — | 26.69 | 90.52 | 78.83 | 50.51 | 27.94 | |
| MENDModel=LLaVA-v1.5, Edit Horizon=100, Parameter-modifying=true2026.05 | 0.08 | 0.11 | 0.04 | 25.52 | 31.33 | 11.42 | — | |
| MENDModel=LLaVA-v1.5 (7B), Number of online edits=1002026.07 | 0.08 | — | 0.04 | 25.52 | 31.33 | 11.42 | 0.11 | |
| MENDModel=BLIP2-OPT, Edit Horizon=100, Parameter-modifying=true2026.05 | 0 | 0 | 0 | 46.96 | 54.05 | 20.2 | — | |
| MENDModel=BLIP2-OPT (2.7B), Number of online edits=1002026.07 | 0 | — | 0 | 46.96 | 54.05 | 20.2 | 0 |