# Continual Visual Instruction Tuning on CVIT Five-type instruction Source: [Continual Visual Instruction Tuning on CVIT Five-type instruction]() Collection index: [llms.txt]() Data updated: 2026-05-15T06:26:11.454Z Evaluation of model performance on the CVIT Five-type instruction dataset, focusing on Continual Visual Instruction Tuning capabilities, measured across various VQA and instruction-following metrics. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Continual Visual Instruction Tuning | | Dataset (including any stated split) | CVIT Five-type instruction | | Metric | ScienceQA Score | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 12 of 12 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [ScienceQA Score](): Higher is better; unit: SCALAR. - [TextVQA Score](): Higher is better; unit: SCALAR. - [Flickr30k Score](): Higher is better; unit: SCALAR. - [ImageNet Accuracy](): Higher is better; unit: PERCENT. - [GQA Score](): Higher is better; unit: SCALAR. - [VQAv2 Score](): Higher is better; unit: SCALAR. - [AP (Average Precision)](): Higher is better; unit: PERCENT. - [MAP (Mean Average Precision)](): Higher is better; unit: PERCENT. - [BWT (Backward Transfer)](): Higher is better; unit: SCALAR. - [MIF Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | ScienceQA Score | Result date | Report paper | | --- | --- | --- | --- | | DirLoRA\* | 83.85 | Not recorded | 68fa7a881e209131cea83bd1 | | SMoLoRA | 80.5 | Not recorded | 68fa7a881e209131cea83bd1 | | LiLoRA | 78.38 | Not recorded | 68fa7a881e209131cea83bd1 | | EWC+TIR | 66.94 | Not recorded | 68fa7a881e209131cea83bd1 | | Replay | 66.06 | Not recorded | 68fa7a881e209131cea83bd1 | | Eproj | 63.45 | Not recorded | 68fa7a881e209131cea83bd1 | | SeqLoRA | 59.21 | Not recorded | 68fa7a881e209131cea83bd1 | | MoeLoRA | 58.09 | Not recorded | 68fa7a881e209131cea83bd1 | | C-LoRA | 55.58 | Not recorded | 68fa7a881e209131cea83bd1 | | EWC | 53.6 | Not recorded | 68fa7a881e209131cea83bd1 | | DoRA | 52.03 | Not recorded | 68fa7a881e209131cea83bd1 | | Zero-shot | 51.85 | Not recorded | 68fa7a881e209131cea83bd1 | ### DirLoRA\* ScienceQA Score: 83.85. Result ID: 6a06bb9947f34ce924eda29b. [Reporting paper]() Recorded evaluation configuration: {"Instruction Setting":"Five-type"}. This record does not assert independent reproduction. ### SMoLoRA ScienceQA Score: 80.5. Result ID: 6a06bb9947f34ce924eda2a4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Instruction Setting":"Five-type"}. This record does not assert independent reproduction. ### LiLoRA ScienceQA Score: 78.38. Result ID: 6a06bb9947f34ce924eda2a5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Instruction Setting":"Five-type"}. This record does not assert independent reproduction. ### EWC+TIR ScienceQA Score: 66.94. Result ID: 6a06bb9947f34ce924eda2a2. [Reporting paper]() Recorded evaluation configuration: {"Instruction Setting":"Five-type"}. This record does not assert independent reproduction. ### Replay ScienceQA Score: 66.06. Result ID: 6a06bb9947f34ce924eda2a0. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Instruction Setting":"Five-type"}. This record does not assert independent reproduction. ### Eproj ScienceQA Score: 63.45. Result ID: 6a06bb9947f34ce924eda2a3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Instruction Setting":"Five-type"}. This record does not assert independent reproduction. ### SeqLoRA ScienceQA Score: 59.21. Result ID: 6a06bb9947f34ce924eda29c. [Reporting paper]() Recorded evaluation configuration: {"Instruction Setting":"Five-type"}. This record does not assert independent reproduction. ### MoeLoRA ScienceQA Score: 58.09. Result ID: 6a06bb9947f34ce924eda29e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Instruction Setting":"Five-type"}. This record does not assert independent reproduction. ### C-LoRA ScienceQA Score: 55.58. Result ID: 6a06bb9947f34ce924eda29f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Instruction Setting":"Five-type"}. This record does not assert independent reproduction. ### EWC ScienceQA Score: 53.6. Result ID: 6a06bb9947f34ce924eda2a1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Instruction Setting":"Five-type"}. This record does not assert independent reproduction. ### DoRA ScienceQA Score: 52.03. Result ID: 6a06bb9947f34ce924eda29d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Instruction Setting":"Five-type"}. This record does not assert independent reproduction. ### Zero-shot ScienceQA Score: 51.85. Result ID: 6a06bb9947f34ce924eda29a. [Reporting paper]() Recorded evaluation configuration: {"Instruction Setting":"Five-type"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.