Lifelong Knowledge Editing on VLKEB Lifelong Sequential
98.77ReliabilityLiveEdit
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| LiveEditBackbone=BLIP2 (2.7B), Number of Edits=12024.11 | 98.77 | 98.08 | 94.89 | 100 | 100 | 98.35 | |
| LiveEditBackbone=BLIP2 (2.7B), Number of Edits=102024.11 | 98.57 | 97.92 | 94.63 | 100 | 100 | 98.22 | |
| LiveEditBackbone=BLIP2 (2.7B), Number of Edits=1002024.11 | 98.2 | 97.67 | 93.96 | 100 | 100 | 97.97 | |
| LiveEditBackbone=BLIP2 (2.7B), Number of Edits=10002024.11 | 97 | 91.92 | 87.53 | 100 | 100 | 95.29 | |
| LiveEditBackbone=LLaVA (7B), Number of Edits=12024.11 | 96.43 | 95.22 | 93.72 | 100 | 100 | 97.08 | |
| LiveEditBackbone=LLaVA (7B), Number of Edits=102024.11 | 95.54 | 94.52 | 91.25 | 100 | 100 | 96.26 | |
| LiveEditBackbone=LLaVA (7B), Number of Edits=1002024.11 | 94.56 | 90.65 | 89.56 | 100 | 100 | 94.95 | |
| FT-LBackbone=LLaVA (7B), Number of Edits=12024.11 | 94.29 | 87 | 92.22 | 91.16 | 91.37 | 91.21 | |
| LiveEditBackbone=LLaVA (7B), Number of Edits=10002024.11 | 92.22 | 83.97 | 82.75 | 100 | 100 | 91.79 | |
| FT-LBackbone=LLaVA (7B), Number of Edits=102024.11 | 88.05 | 85.32 | 85.23 | 74.53 | 85.74 | 83.77 | |
| FT-LBackbone=LLaVA (7B), Number of Edits=1002024.11 | 75.41 | 73.67 | 74.16 | 70.01 | 82.05 | 75.06 | |
| FT-LBackbone=LLaVA (7B), Number of Edits=10002024.11 | 68.14 | 66.38 | 66.98 | 65.61 | 75.35 | 68.49 |