Visual Question Answering on VQA 10% subset
52.14AccuracyBLIP-2 model
Evaluation results
| Method | Links | |
|---|---|---|
| BLIP-2 modelPruning Ratio=No Pruning2024.04 | 52.14 | |
| Self-attention BaselinePruning Ratio=Keep 1/22024.04 | 44.22 | |
| CATPPruning Ratio=Keep 1/2, Pruning Layers=first layer2024.04 | 44.17 | |
| CATPPruning Ratio=Keep 1/2, Pruning Layers=all layers2024.04 | 41.14 | |
| CATPPruning Ratio=Keep 1/4, Pruning Layers=first layer2024.04 | 35.44 | |
| CATPPruning Ratio=Keep 1/4, Pruning Layers=all layers2024.04 | 31.15 | |
| CATPPruning Ratio=Keep 1/8, Pruning Layers=first layer2024.04 | 30.17 | |
| CATPPruning Ratio=Keep 1/8, Pruning Layers=all layers2024.04 | 23.27 | |
| L2-norm BaselinePruning Ratio=Keep 1/22024.04 | 9.5 | |
| L2-norm BaselinePruning Ratio=Keep 1/82024.04 | 8.91 | |
| Self-attention BaselinePruning Ratio=Keep 1/42024.04 | 7.29 | |
| L2-norm BaselinePruning Ratio=Keep 1/42024.04 | 4.75 | |
| Self-attention BaselinePruning Ratio=Keep 1/82024.04 | 1.92 |