Visual Question Answering on VQA v2 (Accuracy)
78.5AccuracyLLaVA-1.5-7B
Evaluation Results
| Method | Links | |
|---|---|---|
| LLaVA-1.5-7BRetained Tokens=5762025.09 | 78.5 | |
| ZOO-PruneRetained Tokens=1922025.09 | 77.34 | |
| DivPruneRetained Tokens=1922025.09 | 76.87 | |
| VisionZipRetained Tokens=1922025.09 | 76.8 | |
| ZOO-PruneRetained Tokens=1282025.09 | 76.57 | |
| DivPruneRetained Tokens=1282025.09 | 75.96 | |
| SparseVLMRetained Tokens=1922025.09 | 75.6 | |
| VisionZipRetained Tokens=1282025.09 | 75.6 | |
| PyramidDropRetained Tokens=1922025.09 | 75.1 | |
| ZOO-PruneRetained Tokens=642025.09 | 75.02 | |
| HiREDRetained Tokens=1922025.09 | 74.9 | |
| DivPruneRetained Tokens=642025.09 | 74.11 | |
| SparseVLMRetained Tokens=1282025.09 | 73.8 | |
| HiREDRetained Tokens=1282025.09 | 73.4 | |
| PyramidDropRetained Tokens=1282025.09 | 72.9 | |
| VisionZipRetained Tokens=642025.09 | 72.4 | |
| HiREDRetained Tokens=642025.09 | 69.7 | |
| PyramidDropRetained Tokens=642025.09 | 69.2 | |
| SparseVLMRetained Tokens=642025.09 | 68.2 | |
| ToMeRetained Tokens=1922025.09 | 68 | |
| FastVRetained Tokens=1922025.09 | 67.1 | |
| ToMeRetained Tokens=1282025.09 | 63 | |
| FastVRetained Tokens=1282025.09 | 61.8 | |
| ToMeRetained Tokens=642025.09 | 57.1 | |
| FastVRetained Tokens=642025.09 | 55 |