Lifelong Editing on VLKEB Lifelong Editing 11
98.1Relational ScoreDSCA
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| DSCABase Model=LLaVA-1.5-7B, Number of edits (t)=10002026.04 | 98.1 | 93.8 | 89.7 | 100 | 100 | 96.72 | |
| LiveEditBase Model=LLaVA-1.5-7B, Number of edits (t)=10002026.04 | 92.22 | 83.97 | 82.75 | 100 | 100 | 91.79 | |
| FT-LBase Model=LLaVA-1.5-7B, Number of edits (t)=10002026.04 | 68.14 | 66.38 | 66.98 | 65.61 | 75.35 | 68.49 | |
| LEMoEBase Model=LLaVA-1.5-7B, Number of edits (t)=10002026.04 | 67.97 | 61.07 | 58.16 | 48.48 | 44.06 | 55.95 | |
| LTEBase Model=LLaVA-1.5-7B, Number of edits (t)=10002026.04 | 64.51 | 56.26 | 64.8 | 80.85 | 76.52 | 68.59 | |
| RECIPEBase Model=LLaVA-1.5-7B, Number of edits (t)=10002026.04 | 62 | 56.84 | 61.5 | 85.37 | 82.07 | 69.56 | |
| SERACBase Model=LLaVA-1.5-7B, Number of edits (t)=10002026.04 | 60.93 | 56.49 | 60.06 | 52.94 | 15.04 | 49.09 | |
| FT-MBase Model=LLaVA-1.5-7B, Number of edits (t)=10002026.04 | 53.41 | 48.8 | 43.16 | 100 | 57.03 | 60.48 | |
| TPBase Model=LLaVA-1.5-7B, Number of edits (t)=10002026.04 | 5.46 | 4.81 | 5.51 | 2.77 | 7.19 | 5.15 | |
| MENDBase Model=LLaVA-1.5-7B, Number of edits (t)=10002026.04 | 0.03 | 0.05 | 0.07 | 0.06 | 0.08 | 0.06 |