Multimodal Continual Instruction Tuning on MLLM-CTBench
49.52Math QA AccuracyOurs (PASs-MoE)
Evaluation Results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Ours (PASs-MoE)Backbone=LLaVA-v1.5-7B, Experts=6, LoRA Rank=1282026.01 | 49.52 | -5.9 | 43.22 | 10.43 | 44.7 | -6.5 | 66.13 | -6.05 | 29.99 | -5.38 | 21.95 | -1.63 | 83.73 | — | 48.46 | -2.15 | |
| DDASBackbone=LLaVA-v1.5-7B, Routing=MoE-based2026.01 | 44.83 | -7.88 | 20.87 | -5.36 | 37.4 | -1.25 | 58.77 | -13.51 | 23.74 | -0.34 | 2.35 | -0.07 | 74.46 | — | 37.49 | -4.06 | |
| MoELoRA (Softmax)Backbone=LLaVA-v1.5-7B, Routing=Softmax2026.01 | 42.98 | -11.45 | 35.89 | 2.65 | 40.84 | -11.61 | 56.1 | -15.47 | 29.24 | -6.04 | 18.89 | -4.57 | 79.57 | — | 43.36 | -6.64 | |
| ReplayBackbone=LLaVA-v1.5-7B2026.01 | 40.64 | -12.56 | 25.44 | -7.97 | 34.37 | -14.09 | 60.15 | -11.83 | 31.79 | -2.34 | 23.68 | -3.21 | 78.25 | — | 42.05 | -8.29 | |
| SeqFTBackbone=LLaVA-v1.5-7B2026.01 | 37.89 | -19.75 | 5.52 | -32.35 | 39.91 | -11.97 | 64.42 | -5.74 | 15.7 | -20.4 | 7.19 | -16.67 | 84.07 | — | 36.39 | -15.27 | |
| MoELoRA (Top-k)Backbone=LLaVA-v1.5-7B, Routing=Top-k2026.01 | 35.68 | -15.06 | 6.78 | -24.18 | 33.58 | -17.69 | 39.8 | -27.18 | 22.67 | -10.89 | 14.57 | -3.41 | 73.56 | — | 32.38 | -15.34 | |
| HiDe-llavaBackbone=LLaVA-v1.5-7B2026.01 | 26.85 | -25.12 | 11.84 | -22.32 | 31.58 | -16.77 | 49.29 | -9.08 | 8.22 | -20.75 | 14.67 | -3.07 | 29.97 | — | 24.63 | -16.16 | |
| O-LoRABackbone=LLaVA-v1.5-7B, LoRA Rank=1282026.01 | 24.58 | -29.85 | 9.87 | -22.61 | 30.79 | -20.98 | 38.48 | -34.01 | 22.82 | -12.85 | 18.64 | -5.92 | 82.44 | — | 32.52 | -19.46 | |
| MASBackbone=LLaVA-v1.5-7B2026.01 | 19.48 | -34.95 | 7.87 | -25.65 | 28.48 | -23.63 | 38.48 | -35.11 | 21.58 | -13.37 | 17.78 | -6.8 | 78.74 | — | 30.34 | -19.36 | |
| LwFBackbone=LLaVA-v1.5-7B2026.01 | 18.98 | -34.71 | 6.45 | -27.01 | 26.8 | -25.31 | 36.51 | -34.66 | 23.61 | -9.94 | 17.38 | -8.1 | 81.68 | — | 30.2 | -19.96 | |
| EWCBackbone=LLaVA-v1.5-7B2026.01 | 16.78 | -36.18 | 6.83 | -26.42 | 25.68 | -26.66 | 37.4 | -36.19 | 23.63 | -11.25 | 17.49 | -4.66 | 83.52 | — | 30.19 | -20.2 | |
| SeqLoRABackbone=LLaVA-v1.5-7B, LoRA Rank=1282026.01 | 0 | -54.43 | 6.28 | -24.81 | 27.75 | -22.18 | 38.44 | -35.15 | 24.7 | -12.54 | 16.96 | -5.53 | 83.52 | — | 28.24 | -22.09 |