Visual Question Answering on GQA (GQA Score, Avg. %, TFLOPS, Latency)
61.94GQA ScoreLLaVA-v1.5-7B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LLaVA-v1.5-7BRetain Tokens=Original2026.05 | 61.94 | 100 | 8.54 | 167.5 | |
| COASTRetain Tokens=2882026.05 | 61.43 | 99.63 | 4.68 | 104.45 | |
| SparseVLMRetain Tokens=2882026.05 | 61.23 | 99.13 | 5.02 | 109.12 | |
| MMTOKRetain Tokens=2882026.05 | 61.2 | 98.62 | 4.51 | 125.75 | |
| COASTRetain Tokens=1922026.05 | 61.03 | 99.79 | 3.44 | 89.93 | |
| V^2DropRetain Tokens=2882026.05 | 60.77 | 99.59 | 4.68 | 136.4 | |
| PDropRetain Tokens=2882026.05 | 60.6 | 99.28 | 4.72 | 105.96 | |
| MMTOKRetain Tokens=1922026.05 | 60.22 | 97.77 | 3.25 | 94.62 | |
| FastVRetain Tokens=2882026.05 | 59.9 | 99.25 | 4.7 | 125.8 | |
| MMTOKRetain Tokens=1282026.05 | 59.48 | 96.99 | 2.42 | 80.47 | |
| SparseVLMRetain Tokens=1922026.05 | 59.42 | 98.39 | 3.86 | 92.07 | |
| COASTRetain Tokens=1282026.05 | 58.8 | 98.64 | 2.6 | 77.94 | |
| V^2DropRetain Tokens=1922026.05 | 58.6 | 98.53 | 3.42 | 113.78 | |
| SparseVLMRetain Tokens=1282026.05 | 58.51 | 97.81 | 2.9 | 68.73 | |
| FastVRetain Tokens=1922026.05 | 57.77 | 98.32 | 3.44 | 84.22 | |
| PDropRetain Tokens=1922026.05 | 57.35 | 97.08 | 3.46 | 81.94 | |
| V^2DropRetain Tokens=1282026.05 | 56.19 | 96.2 | 2.59 | 92.8 | |
| PDropRetain Tokens=1282026.05 | 55.72 | 95.77 | 2.68 | 67.59 | |
| FastVRetain Tokens=1282026.05 | 54.6 | 96.8 | 2.62 | 74.28 |