Scientific Question Answering on ScienceQA I
69.96AccuracyCVLM (3M IKPairs) w/o FKA
Evaluation results
| Method | Links | |
|---|---|---|
| CVLM (3M IKPairs) w/o FKAVKA=true, FKA=false, Pre-training Data Scale=3M IKPairs2024.02 | 69.96 | |
| CVLM (3M IKPairs)VKA=true, FKA=true, Pre-training Data Scale=3M IKPairs2024.02 | 69.85 | |
| CVLM w/o FKAVKA=true, FKA=false2024.02 | 69.21 | |
| CVLMVKA=true, FKA=true2024.02 | 68.92 | |
| MoELoRABase Model=LLaVA-1.5-7B, Rank (r)=82024.08 | 68.7 | |
| TeamLoRABase Model=LLaVA-1.5-7B, Rank (r)=82024.08 | 68.7 | |
| LoRABase Model=LLaVA-1.5-7B, Rank (r)=322024.08 | 67.8 | |
| CVLM w/o (FKA & VKA)VKA=false, FKA=false2024.02 | 62.76 |