Visual Question Answering on OKVQA (Accuracy, Average performance retention)
60.13AccuracyLLaVA-NeXT 8B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LLaVA-NeXT 8BBackbone=LLaVA-NeXT 8B, Sparsity Level=0%, Pruning Method=Dense, Pruning Type=None2026.03 | 60.13 | 100 | |
| Qwen2-VL 7BBackbone=Qwen2-VL 7B, Sparsity Level=0%, Pruning Method=Dense, Pruning Type=None2026.03 | 52.12 | 100 | |
| ATV-PruningBackbone=LLaVA-NeXT 8B, Sparsity Level=50%, Pruning Method=ATV-Pruning, Pruning Type=unstructured, uniform pruning2026.03 | 45.34 | 94 | |
| TAMPBackbone=LLaVA-NeXT 8B, Sparsity Level=50%, Pruning Method=TAMP, Pruning Type=unstructured, uniform pruning2026.03 | 43.59 | 92.67 | |
| SparseGPTBackbone=LLaVA-NeXT 8B, Sparsity Level=50%, Pruning Method=SparseGPT, Pruning Type=unstructured, uniform pruning2026.03 | 38.17 | 91.74 | |
| SparseGPTBackbone=Qwen2-VL 7B, Sparsity Level=60%, Pruning Method=SparseGPT, Pruning Type=unstructured, uniform pruning2026.03 | 29.5 | 85.3 | |
| WandaBackbone=LLaVA-NeXT 8B, Sparsity Level=50%, Pruning Method=Wanda, Pruning Type=unstructured, uniform pruning2026.03 | 25.38 | 88.36 | |
| ATV-PruningBackbone=Qwen2-VL 7B, Sparsity Level=60%, Pruning Method=ATV-Pruning, Pruning Type=unstructured, uniform pruning2026.03 | 23.73 | 85.65 | |
| TAMPBackbone=Qwen2-VL 7B, Sparsity Level=60%, Pruning Method=TAMP, Pruning Type=unstructured, uniform pruning2026.03 | 15.93 | 83.79 | |
| ATV-PruningBackbone=LLaVA-NeXT 8B, Sparsity Level=60%, Pruning Method=ATV-Pruning, Pruning Type=unstructured, uniform pruning2026.03 | 11.13 | 77.01 | |
| TAMPBackbone=LLaVA-NeXT 8B, Sparsity Level=60%, Pruning Method=TAMP, Pruning Type=unstructured, uniform pruning2026.03 | 6.73 | 73.75 | |
| WandaBackbone=Qwen2-VL 7B, Sparsity Level=60%, Pruning Method=Wanda, Pruning Type=unstructured, uniform pruning2026.03 | 6.3 | 77.78 | |
| SparseGPTBackbone=LLaVA-NeXT 8B, Sparsity Level=60%, Pruning Method=SparseGPT, Pruning Type=unstructured, uniform pruning2026.03 | 5.56 | 76.24 | |
| WandaBackbone=LLaVA-NeXT 8B, Sparsity Level=60%, Pruning Method=Wanda, Pruning Type=unstructured, uniform pruning2026.03 | 0.9 | 64.45 |