Lifelong Editing on E-VQA Lifelong Editing 5
96.85Relational ScoreDSCA
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| DSCABase Model=LLaVA-1.5-7B, Number of edits (t)=10002026.04 | 96.85 | 93.1 | 88 | 100 | 98.2 | 95.23 | |
| LiveEditBase Model=LLaVA-1.5-7B, Number of edits (t)=10002026.04 | 92.93 | 90.16 | 84.3 | 100 | 96.43 | 92.76 | |
| RECIPEBase Model=LLaVA-1.5-7B, Number of edits (t)=10002026.04 | 87 | 76.81 | 83.09 | 86.95 | 87.03 | 84.18 | |
| SERACBase Model=LLaVA-1.5-7B, Number of edits (t)=10002026.04 | 85.57 | 75.58 | 82.01 | 62.46 | 15.69 | 64.26 | |
| LTEBase Model=LLaVA-1.5-7B, Number of edits (t)=10002026.04 | 83.93 | 82.55 | 81.34 | 83.97 | 73.09 | 80.98 | |
| FT-LBase Model=LLaVA-1.5-7B, Number of edits (t)=10002026.04 | 71.39 | 59.83 | 57.41 | 55.55 | 48.99 | 58.63 | |
| FT-MBase Model=LLaVA-1.5-7B, Number of edits (t)=10002026.04 | 69.57 | 56.34 | 44.07 | 100 | 41.47 | 62.29 | |
| LEMoEBase Model=LLaVA-1.5-7B, Number of edits (t)=10002026.04 | 30.8 | 25.75 | 24.32 | 71.45 | 46.23 | 39.71 | |
| TPBase Model=LLaVA-1.5-7B, Number of edits (t)=10002026.04 | 16.56 | 16.8 | 15.65 | 7.28 | 15.6 | 14.38 | |
| MENDBase Model=LLaVA-1.5-7B, Number of edits (t)=10002026.04 | 0.04 | 0.05 | 0.05 | 0.08 | 0.09 | 0.06 |