Knowledge Transfer on LLaVA-1.5 Evaluation Suite OKVQA
78.52VQAv2 AccuracyZero-shot
Evaluation Results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Zero-shotSparsity ratio (r)=10%2025.05 | 78.52 | 61.97 | 50 | 70.17 | 58.28 | 85.97 | 64.78 | 58.51 | 0.14 | 27.94 | 33.09 | |
| DARE#Params=273M, Sparsity ratio (r)=10%2025.05 | 78.04 | 61.65 | 49.19 | 67.58 | 57.91 | 86.44 | 65.03 | 58.16 | 0.83 | 58.31 | 1.64 | |
| NPS#Params=273M, Sparsity ratio (r)=10%2025.05 | 76.81 | 60.94 | 48.1 | 71.32 | 56.34 | 87.23 | 64.77 | 57.5 | 38.4 | 62.38 | 48.38 | |
| Model Tailor#Params=273M, Sparsity ratio (r)=10%2025.05 | 76.25 | 60.39 | 46.49 | 69.51 | 54.88 | 85.44 | 63.32 | 54.21 | 38.1 | 60.95 | 47.71 | |
| Grafting#Params=273M, Sparsity ratio (r)=10%2025.05 | 75.23 | 58.42 | 43.27 | 67.26 | 53.51 | 85.29 | 62.16 | 54.42 | 30.8 | 58.93 | 41.25 | |
| Fine-tune#Params=2.7B, Sparsity ratio (r)=10%2025.05 | 69.1 | 48.61 | 30.35 | 41.03 | 42.13 | 72.33 | 32.79 | 43.47 | 46.27 | 47.34 | 46.87 |