Visual Instruction Tuning on LLaVA Evaluation Suite 1.5 (test)
68.5Average ScoreLoRA
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| LoRABackbone=LLaVA1.5-7B, #Params.=4.61%2024.08 | 68.5 | 62.4 | 68.5 | 56.9 | 86 | |
| RoAd1 + LoRABackbone=LLaVA1.5-7B, #Params.=1.19%2024.08 | 68.5 | 62.5 | 68.2 | 57.4 | 85.8 | |
| DoRAParams=4.63%2026.05 | 67.6 | — | — | — | — | |
| FURAParams=1.37%2026.05 | 67.6 | — | — | — | — | |
| LoRAParams=4.61%2026.05 | 66.9 | — | — | — | — | |
| Full FTParams=100%2026.05 | 66.5 | — | — | — | — | |
| RoAd4Backbone=LLaVA1.5-7B, #Params.=0.08%2024.08 | 66.4 | 60 | 66.9 | 53.3 | 85.5 |