Continual Visual Instruction Tuning on CVIT Single-type instruction
88.13AP (Average Precision)DirLoRA*
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| DirLoRA*Instruction Setting=Single-type2025.08 | 88.13 | 83.75 | 60.66 | 164.2 | 96.71 | 58.55 | 64.93 | 90.18 | 0 | 98.41 | |
| LiLoRAInstruction Setting=Single-type2025.08 | 84.88 | 77.88 | 58.83 | 152.93 | 96.02 | 58.28 | 65.33 | 87.7 | -3.13 | 98.24 | |
| SMoLoRAInstruction Setting=Single-type2025.08 | 83.44 | 77.36 | 58.29 | 151.99 | 95.35 | 51.96 | 65.71 | 84.85 | -3.23 | 97.79 | |
| DirLoRABackbone=Qwen2-VL-2B, Instruction Setting=Single-type instruction setting2025.08 | 67.55 | — | — | — | — | — | — | 74.14 | 0 | 93.81 | |
| EprojInstruction Setting=Single-type2025.08 | 65.29 | 65.29 | 52.87 | 148.19 | 39.45 | 28.06 | 57.86 | 73.53 | -14.02 | 89.81 | |
| LiLoRABackbone=Qwen2-VL-2B, Instruction Setting=Single-type instruction setting2025.08 | 64.63 | — | — | — | — | — | — | 68.3 | -0.94 | 92.94 | |
| EprojBackbone=Qwen2-VL-2B, Instruction Setting=Single-type instruction setting2025.08 | 58.87 | — | — | — | — | — | — | 61.21 | -2.47 | 90.12 | |
| ReplayInstruction Setting=Single-type2025.08 | 49.7 | 75.61 | 47.58 | 31.97 | 35.84 | 48.51 | 58.67 | 69.78 | -22.71 | 82.06 | |
| EWC+TIRInstruction Setting=Single-type2025.08 | 47.19 | 72.22 | 44.78 | 34.54 | 25.98 | 46.86 | 58.73 | 67.21 | -25.64 | 81.62 | |
| EWCInstruction Setting=Single-type2025.08 | 46.26 | 57.04 | 50.02 | 32.96 | 22.85 | 50.16 | 64.54 | 56.19 | -49.71 | 78.9 | |
| SeqLoRAInstruction Setting=Single-type2025.08 | 46.21 | 55.31 | 50.22 | 33.89 | 22.73 | 50.52 | 64.61 | 57.41 | -48.1 | 78.35 | |
| C-LoRAInstruction Setting=Single-type2025.08 | 45.78 | 57.25 | 38.7 | 56.5 | 25.27 | 42.89 | 54.06 | 57.04 | -19.58 | 65.84 | |
| SeqLoRABackbone=Qwen2-VL-2B, Instruction Setting=Single-type instruction setting2025.08 | 45.41 | — | — | — | — | — | — | 53.39 | -6.42 | 70.91 | |
| MoeLoRAInstruction Setting=Single-type2025.08 | 45.27 | 55.01 | 48.87 | 32.04 | 22 | 50.03 | 63.64 | 56.16 | -48.05 | 79.97 | |
| DoRAInstruction Setting=Single-type2025.08 | 44.07 | 51.26 | 46.36 | 36.41 | 28.24 | 45.29 | 56.87 | 65.03 | -31.12 | 78.59 | |
| Zero-shotInstruction Setting=Single-type2025.08 | 22.3 | 52.72 | 2.95 | 52.64 | 22.1 | 2.73 | 0.65 | — | — | 17.84 |