Continual Visual Instruction Tuning on CVIT
49.63ADDirFT
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| DirFT2025.11 | 49.63 | 93.96 | 152.6 | 86.56 | 83.42 | 56.6 | 87.13 | — | |
| HPAData Condition=Original Data2025.11 | 35.01 | 60.48 | 144.8 | 82.73 | 78.99 | 52.36 | 75.73 | -4.87 | |
| HPAData Condition=0.1% Harmful Data Injected2025.11 | 34.35 | 63.49 | 148.62 | 82.13 | 78.76 | 52.34 | 76.62 | -3.88 | |
| Safe DeltaData Condition=Original Data2025.11 | 33.67 | 46.36 | 142.1 | 83.78 | 80.35 | 53.67 | 73.32 | -6.91 | |
| Safe DeltaData Condition=0.1% Harmful Data Injected2025.11 | 26.01 | 47.98 | 146.82 | 83.8 | 81.04 | 53.54 | 73.2 | -6.82 | |
| ReplayData Condition=0.1% Harmful Data Injected2025.11 | 23.48 | 59.27 | 129.41 | 86.46 | 82.05 | 56.74 | 72.9 | -17.89 | |
| ReplayData Condition=Original Data2025.11 | 21.33 | 25.64 | 141.96 | 85.32 | 81.41 | 59.85 | 69.25 | -21.4 | |
| Model TailorData Condition=Original Data2025.11 | 20.32 | 35.88 | 145.76 | 79.04 | 78.89 | 52.84 | 68.79 | -10.29 | |
| EWCData Condition=Original Data2025.11 | 19.52 | 46.08 | 106.51 | 84.77 | 81.7 | 56.53 | 65.85 | -24.9 | |
| SeqFTData Condition=Original Data2025.11 | 19.32 | 45.19 | 106.64 | 85.23 | 81.13 | 56.6 | 65.68 | -25.62 | |
| Zero-shot2025.11 | 18.95 | 20.63 | 6.55 | 0.04 | 24.5 | 0.02 | 11.78 | — | |
| SEFEData Condition=Original Data2025.11 | 17.92 | 41.01 | 127.27 | 79.71 | 78.89 | 54.19 | 66.49 | -20.83 | |
| Model TailorData Condition=0.1% Harmful Data Injected2025.11 | 17.83 | 42.04 | 155.64 | 77.06 | 78.83 | 54.03 | 70.91 | -11.79 | |
| SPPFTData Condition=Original Data2025.11 | 16.26 | 43.86 | 110.34 | 78.22 | 63.97 | 53.7 | 61.06 | -29.81 | |
| EWCData Condition=0.1% Harmful Data Injected2025.11 | 16.04 | 43.41 | 109.98 | 83.23 | 80.92 | 56.06 | 64.94 | -25.81 | |
| SeqFTData Condition=0.1% Harmful Data Injected2025.11 | 15.98 | 50.24 | 111.39 | 84.07 | 81.58 | 56.86 | 66.69 | -24.29 | |
| SEFEData Condition=0.1% Harmful Data Injected2025.11 | 14.81 | 41.37 | 126.72 | 81.18 | 78.89 | 54.17 | 66.19 | -20.59 | |
| SPPFTData Condition=0.1% Harmful Data Injected2025.11 | 14.8 | 43.82 | 105.76 | 68.96 | 68.85 | 53.8 | 59.33 | -31.21 |