Task-incremental continual instruction tuning on CoIN
67.4Average PerformanceMulti-task (upper bound)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Multi-task (upper bound)Backbone=LLaVA-v1.5-7B2026.07 | 67.4 | — | |
| INDUCEKVBackbone=LLaVA-OV-4B2026.07 | 66.38 | 65.72 | |
| INDUCEKVBackbone=LLaVA-v1.5-7B2026.07 | 66.05 | 65.38 | |
| HiDe-LLaVABackbone=LLaVA-v1.5-7B2026.07 | 64.7 | 63.95 | |
| O-LoRABackbone=LLaVA-v1.5-7B2026.07 | 62.6 | 60.77 | |
| MoELoRABackbone=LLaVA-v1.5-7B2026.07 | 55.24 | 50.58 | |
| Zero-shot (lower bound)Backbone=LLaVA-v1.5-7B2026.07 | 54.21 | — | |
| L2PBackbone=LLaVA-v1.5-7B2026.07 | 53.96 | 52.83 | |
| EWCBackbone=LLaVA-v1.5-7B2026.07 | 53.3 | 48.95 | |
| LwFBackbone=LLaVA-v1.5-7B2026.07 | 53.22 | 48.4 | |
| FineTuneBackbone=LLaVA-v1.5-7B2026.07 | 52.86 | 47.31 |