Visual Question Answering on VizWiz (Performance and Efficiency)
55.58Accuracy (VizWiz)V^2Drop
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| V^2DropRetain Tokens=1922026.05 | 55.58 | 98.53 | 3.42 | 113.78 | |
| V^2DropRetain Tokens=2882026.05 | 55.47 | 99.59 | 4.68 | 136.4 | |
| V^2DropRetain Tokens=1282026.05 | 55.35 | 96.2 | 2.59 | 92.8 | |
| MMTOKRetain Tokens=1282026.05 | 55.15 | 96.99 | 2.42 | 80.47 | |
| FastVRetain Tokens=1282026.05 | 54.99 | 96.8 | 2.62 | 74.28 | |
| FastVRetain Tokens=1922026.05 | 54.87 | 98.32 | 3.44 | 84.22 | |
| MMTOKRetain Tokens=1922026.05 | 54.69 | 97.77 | 3.25 | 94.62 | |
| SparseVLMRetain Tokens=1922026.05 | 54.4 | 98.39 | 3.86 | 92.07 | |
| COASTRetain Tokens=2882026.05 | 54.38 | 99.63 | 4.68 | 104.45 | |
| FastVRetain Tokens=2882026.05 | 54.19 | 99.25 | 4.7 | 125.8 | |
| MMTOKRetain Tokens=2882026.05 | 54.12 | 98.62 | 4.51 | 125.75 | |
| LLaVA-v1.5-7BRetain Tokens=Original2026.05 | 54.01 | 100 | 8.54 | 167.5 | |
| COASTRetain Tokens=1922026.05 | 53.77 | 99.79 | 3.44 | 89.93 | |
| SparseVLMRetain Tokens=1282026.05 | 53.71 | 97.81 | 2.9 | 68.73 | |
| SparseVLMRetain Tokens=2882026.05 | 53.45 | 99.13 | 5.02 | 109.12 | |
| PDropRetain Tokens=2882026.05 | 53.42 | 99.28 | 4.72 | 105.96 | |
| PDropRetain Tokens=1282026.05 | 52.91 | 95.77 | 2.68 | 67.59 | |
| COASTRetain Tokens=1282026.05 | 52.86 | 98.64 | 2.6 | 77.94 | |
| PDropRetain Tokens=1922026.05 | 52.33 | 97.08 | 3.46 | 81.94 |