Continual Visual Instruction Tuning on CVIT Five-type instruction
83.85ScienceQA ScoreDirLoRA*
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| DirLoRA*Instruction Setting=Five-type2025.08 | 83.85 | 60.51 | 164.66 | 96.71 | 57.93 | 64.9 | 88.09 | 91.49 | 0 | 98.31 | |
| SMoLoRAInstruction Setting=Five-type2025.08 | 80.5 | 58.3 | 146.63 | 94.28 | 52.42 | 65.96 | 83.02 | 85.05 | -6.5 | 98.12 | |
| LiLoRAInstruction Setting=Five-type2025.08 | 78.38 | 59.14 | 155.26 | 95.82 | 56.27 | 64.74 | 84.94 | 87.43 | -1.94 | 98.16 | |
| EWC+TIRInstruction Setting=Five-type2025.08 | 66.94 | 45.76 | 29.49 | 21.68 | 46.9 | 58.8 | 44.93 | 64.51 | -26.38 | 80.56 | |
| ReplayInstruction Setting=Five-type2025.08 | 66.06 | 47.78 | 24.21 | 25.66 | 46.53 | 58.59 | 44.81 | 66.68 | -26.88 | 80.38 | |
| EprojInstruction Setting=Five-type2025.08 | 63.45 | 53.18 | 151.41 | 20.63 | 45.3 | 57.32 | 65.22 | 72.1 | -14.43 | 89.93 | |
| SeqLoRAInstruction Setting=Five-type2025.08 | 59.21 | 50.8 | 20.99 | 20.3 | 49.98 | 64.41 | 44.28 | 53.75 | -48.73 | 79.47 | |
| MoeLoRAInstruction Setting=Five-type2025.08 | 58.09 | 53.3 | 22.82 | 22.61 | 51.8 | 65.15 | 45.63 | 54.88 | -49.94 | 78.19 | |
| C-LoRAInstruction Setting=Five-type2025.08 | 55.58 | 38.64 | 59.05 | 22.81 | 40.93 | 51.65 | 44.78 | 52.37 | -18.83 | 70.01 | |
| EWCInstruction Setting=Five-type2025.08 | 53.6 | 49.07 | 20.38 | 20.48 | 50.11 | 64.63 | 43.1 | 53.94 | -52.47 | 78.18 | |
| DoRAInstruction Setting=Five-type2025.08 | 52.03 | 47.37 | 27.97 | 26.18 | 46.05 | 57.33 | 42.82 | 56.24 | -34.11 | 78.3 | |
| Zero-shotInstruction Setting=Five-type2025.08 | 51.85 | 5.11 | 44.05 | 20.34 | 2.37 | 1.16 | 20.81 | — | — | 19.45 |