Knowledge Transfer on LLaVA Evaluation Suite Flickr30k 1.5
78.52VQAv2 AccuracyZero-shot
Evaluation Results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Zero-shotSparsity ratio (r)=10%2025.05 | 78.52 | 61.97 | 50 | 70.17 | 58.28 | 85.97 | 64.78 | 58.51 | 18.62 | 42.33 | 29.05 | |
| DARE#Params=273M, Sparsity ratio (r)=10%2025.05 | 78.12 | 59.25 | 48.9 | 64.92 | 57.17 | 84.86 | 64.77 | 57.47 | 25.6 | 60.12 | 36.64 | |
| Grafting#Params=273M, Sparsity ratio (r)=10%2025.05 | 74.48 | 58.28 | 43.16 | 66.82 | 52.56 | 80.35 | 64.52 | 55.49 | 58.2 | 61.56 | 60.03 | |
| NPS#Params=273M, Sparsity ratio (r)=10%2025.05 | 74.3 | 52.52 | 43.1 | 66.12 | 43.93 | 83.23 | 64.52 | 57.51 | 76.2 | 62.38 | 67.54 | |
| Model Tailor#Params=273M, Sparsity ratio (r)=10%2025.05 | 73.21 | 52.49 | 42.28 | 67.15 | 43.89 | 82.88 | 63.4 | 56.15 | 75.4 | 61.87 | 66.94 | |
| Fine-tune#Params=2.7B, Sparsity ratio (r)=10%2025.05 | 68.61 | 49.01 | 27.24 | 63.86 | 40.03 | 79.73 | 59.02 | 50.17 | 77.1 | 56.42 | 63.4 |