Task-incremental continual instruction tuning on UCIT
74.78Average PerformanceMulti-task (upper bound)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Multi-task (upper bound)Backbone=LLaVA-v1.5-7B2026.07 | 74.78 | — | |
| INDUCEKVBackbone=LLaVA-OV-4B2026.07 | 70.25 | 65.84 | |
| INDUCEKVBackbone=LLaVA-v1.5-7B2026.07 | 69.82 | 65.31 | |
| HiDe-LLaVABackbone=LLaVA-v1.5-7B2026.07 | 68.94 | 64.19 | |
| O-LoRABackbone=LLaVA-v1.5-7B2026.07 | 64.54 | 58.36 | |
| MoELoRABackbone=LLaVA-v1.5-7B2026.07 | 61.33 | 52.06 | |
| LwFBackbone=LLaVA-v1.5-7B2026.07 | 59.4 | 49.52 | |
| EWCBackbone=LLaVA-v1.5-7B2026.07 | 59.34 | 50.2 | |
| FineTuneBackbone=LLaVA-v1.5-7B2026.07 | 57.52 | 48.12 | |
| L2PBackbone=LLaVA-v1.5-7B2026.07 | 53.99 | 48.51 | |
| Zero-shot (lower bound)Backbone=LLaVA-v1.5-7B2026.07 | 31.68 | — |