Multimodal Continual Instruction Tuning on UCIT
74.73Average Score (UCIT)CRAM
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| CRAM2026.06 | 74.73 | 87.23 | 92.17 | — | 80.43 | 70.67 | 57.35 | 60.55 | — | |
| SAMEBackbone=LLaVA-v1.5-7B2026.05 | 73.07 | 89.91 | 91.4 | — | 77.51 | 68.85 | 55.43 | 55.33 | — | |
| SAME2026.06 | 73.07 | 89.91 | 91.4 | — | 77.51 | 68.85 | 55.43 | 55.33 | — | |
| DISCOBackbone=LLaVA-v1.5-7B2026.05 | 69.54 | 88.88 | 94.25 | — | 69.5 | 60.75 | 56.32 | 47.52 | — | |
| DISCO2026.06 | 69.54 | 88.88 | 94.25 | — | 69.5 | 60.75 | 56.32 | 47.52 | — | |
| DRAPEBackbone=LLaVA-v1.5-7B2026.05 | 69.41 | 85.07 | 91.6 | 55.68 | 62.53 | 65.77 | 55.82 | — | — | |
| ModalPromptBackbone=LLaVA-v1.5-7B2026.05 | 67.93 | 80.5 | 90.62 | — | 63.5 | 55.75 | 57.09 | 60.13 | — | |
| ModalPrompt2026.06 | 67.93 | 80.5 | 90.62 | — | 63.5 | 55.75 | 57.09 | 60.13 | — | |
| SEFEBackbone=LLaVA-v1.5-7B2026.05 | 66.54 | 80.83 | 78 | 47.01 | 69.63 | 65.83 | 57.92 | — | — | |
| O-LoRABackbone=LLaVA-v1.5-7B2026.05 | 64.35 | 77.5 | 78.07 | 44.5 | 63.13 | 64.73 | 58.16 | — | — | |
| HiDeBackbone=LLaVA-v1.5-7B2026.05 | 62.29 | 84.03 | 90.73 | 44.43 | 58.93 | 41.37 | 54.25 | — | — | |
| LoRA-FTBackbone=LLaVA-v1.5-7B2026.05 | 61.24 | 58.03 | 77.63 | 44.39 | 67.4 | 61.77 | 58.22 | — | — | |
| Replay-LoRABackbone=LLaVA-v1.5-7B2026.05 | 61.18 | 76.93 | 87.07 | — | 56.43 | 36.4 | 55.94 | 54.31 | — | |
| Replay-LoRA2026.06 | 61.18 | 76.93 | 87.07 | — | 56.43 | 36.4 | 55.94 | 54.31 | — | |
| MoE-LoRABackbone=LLaVA-v1.5-7B2026.05 | 60.79 | 58.43 | 77.57 | — | 68.9 | 56.73 | 58.27 | 44.83 | — | |
| MoE-LoRA2026.06 | 60.79 | 58.43 | 77.57 | — | 68.9 | 56.73 | 58.27 | 44.83 | — | |
| HiDe-LLaVABackbone=LLaVA-v1.5-7B2026.05 | 60.08 | 87.62 | 91.12 | — | 57.62 | 31 | 50.41 | 42.68 | — | |
| HiDe-LLaVA2026.06 | 60.08 | 87.62 | 91.12 | — | 57.62 | 31 | 50.41 | 42.68 | — | |
| CL-MoEBackbone=LLaVA-v1.5-7B2026.05 | 59.69 | 64.12 | 78.38 | — | 62 | 50.75 | 58.06 | 44.83 | — | |
| CL-MoE2026.06 | 59.69 | 64.12 | 78.38 | — | 62 | 50.75 | 58.06 | 44.83 | — | |
| MoELoRABackbone=LLaVA-v1.5-7B2026.05 | 58.98 | 70.07 | 77.7 | 44.69 | 50.03 | 54.03 | 57.34 | — | — | |
| CL-MoEBackbone=LLaVA-v1.5-7B2026.05 | 58.49 | 66.33 | 77 | 44.78 | 51.87 | 53.53 | 57.42 | — | — | |
| JointBackbone=LLaVA-1.5-7B2026.06 | 54.8 | — | — | — | — | — | — | — | 56.2 | |
| ASRBackbone=Qwen2.5-VL-7B2026.06 | 53.3 | — | — | — | — | — | — | — | 55 | |
| ASRBackbone=InternVL3-8B2026.06 | 52.8 | — | — | — | — | — | — | — | 54.5 | |
| ModalPromptBackbone=LLaVA-v1.5-7B2026.05 | 52.53 | 51.07 | 87.27 | 48.11 | 39.23 | 46.57 | 42.93 | — | — | |
| ASRBackbone=LLaVA-1.5-7B2026.06 | 51.5 | — | — | — | — | — | — | — | 53.1 | |
| Adapt-∞Backbone=LLaVA-1.5-7B2026.06 | 50.2 | — | — | — | — | — | — | — | 51.7 | |
| PCLRBackbone=LLaVA-7B2026.06 | 49.8 | — | — | — | — | — | — | — | 51.3 | |
| D-MoLEBackbone=InternVL2-2B2026.06 | 49.4 | — | — | — | — | — | — | — | 51.2 | |
| BranchLoRABackbone=LLaVA-1.5-7B2026.06 | 47.9 | — | — | — | — | — | — | — | 49.7 | |
| SEFEBackbone=LLaVA-1.5-7B2026.06 | 47.3 | — | — | — | — | — | — | — | 49 | |
| HiDe-LLaVABackbone=LLaVA-1.5-7B2026.06 | 46 | — | — | — | — | — | — | — | 47.8 | |
| MoELoRABackbone=LLaVA-1.5-7B2026.06 | 44.3 | — | — | — | — | — | — | — | 45.9 | |
| O-LoRABackbone=LLaVA-1.5-7B2026.06 | 42.1 | — | — | — | — | — | — | — | 43.2 | |
| LoRA-FTBackbone=LLaVA-1.5-7B2026.06 | 39.8 | — | — | — | — | — | — | — | 41.5 | |
| FT-LoRABackbone=LLaVA-v1.5-7B2026.05 | 37.9 | 29.33 | 55.3 | — | 26.13 | 13.07 | 58.07 | 45.51 | — | |
| FT-LoRA2026.06 | 37.9 | 29.33 | 55.3 | — | 26.13 | 13.07 | 58.07 | 45.51 | — | |
| Zero-shotBackbone=LLaVA-v1.5-7B2026.05 | 32.34 | 18.88 | 52.62 | — | 21.25 | 21.12 | 41.44 | 38.75 | — | |
| Zero-shotSetting=Zero-shot2026.06 | 32.34 | 18.88 | 52.62 | — | 21.25 | 21.12 | 41.44 | 38.75 | — | |
| Zero-shotBackbone=LLaVA-v1.5-7B2026.05 | — | 16.27 | 53.73 | 38.39 | 19.2 | 20.63 | 41.88 | — | — |