Knowledge Editing on VLKEB (test)
100Reliability (Rel)FT(LLM)
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| FT(LLM)Model=Gemma32026.05 | 100 | 99.67 | 100 | 80.3 | 33.03 | 21.34 | |
| FT(LLM)Model=InternVL3.52026.05 | 100 | 98.44 | 99.3 | 87.02 | 18.26 | 1.33 | |
| IKEModel=Gemma32026.05 | 99.6 | 99.56 | 99.67 | 50.1 | 12.82 | 43.88 | |
| LDKEModel=InternVL3.52026.05 | 97.78 | 97 | 98.62 | 100 | 99.78 | 18.62 | |
| MENDModel=Gemma32026.05 | 97.56 | 96.88 | 95.35 | 99.16 | 90.35 | 37.65 | |
| LDKEModel=Gemma32026.05 | 96.77 | 97.5 | 96.5 | 100 | 99.12 | 45.21 | |
| MENDModel=InternVL3.52026.05 | 96.37 | 95.48 | 95.5 | 95.6 | 92.18 | 9.12 | |
| VisEditModel=Gemma32026.05 | 96.12 | 95.18 | 95.72 | 100 | 74.67 | 33.35 | |
| IKEModel=InternVL3.52026.05 | 95.54 | 97.65 | 95.31 | 68.94 | 18.86 | 13.7 | |
| MSCKEModel=Gemma32026.05 | 95.32 | 94.85 | 95.32 | 100 | 99.44 | 33.33 | |
| VisEditModel=InternVL3.52026.05 | 93.83 | 91.11 | 92.2 | 99.5 | 70.68 | 10.9 | |
| FT(Vis)Model=InternVL3.52026.05 | 93.11 | 10.88 | 83.57 | 100 | 69.78 | 1.02 | |
| MSCKEModel=InternVL3.52026.05 | 92.68 | 91.73 | 94.37 | 99.95 | 98.87 | 1.4 | |
| FT(Vis)Model=Gemma32026.05 | 90.28 | 58.35 | 34.75 | 100 | 18.83 | 27.31 |