Multimodal Reasoning on MMBench (Accuracy and Efficiency)
64.35MMBench AccuracyPDrop
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| PDropRetain Tokens=2882026.05 | 64.35 | 99.28 | 4.72 | 105.96 | |
| COASTRetain Tokens=2882026.05 | 64.18 | 99.63 | 4.68 | 104.45 | |
| LLaVA-v1.5-7BRetain Tokens=Original2026.05 | 64.09 | 100 | 8.54 | 167.5 | |
| V^2DropRetain Tokens=2882026.05 | 64.09 | 99.59 | 4.68 | 136.4 | |
| MMTOKRetain Tokens=2882026.05 | 64.09 | 98.62 | 4.51 | 125.75 | |
| SparseVLMRetain Tokens=2882026.05 | 64.08 | 99.13 | 5.02 | 109.12 | |
| COASTRetain Tokens=1922026.05 | 63.92 | 99.79 | 3.44 | 89.93 | |
| SparseVLMRetain Tokens=1922026.05 | 63.75 | 98.39 | 3.86 | 92.07 | |
| FastVRetain Tokens=2882026.05 | 63.75 | 99.25 | 4.7 | 125.8 | |
| SparseVLMRetain Tokens=1282026.05 | 63.66 | 97.81 | 2.9 | 68.73 | |
| MMTOKRetain Tokens=1922026.05 | 63.66 | 97.77 | 3.25 | 94.62 | |
| COASTRetain Tokens=1282026.05 | 63.57 | 98.64 | 2.6 | 77.94 | |
| FastVRetain Tokens=1922026.05 | 62.97 | 98.32 | 3.44 | 84.22 | |
| PDropRetain Tokens=1922026.05 | 62.63 | 97.08 | 3.46 | 81.94 | |
| MMTOKRetain Tokens=1282026.05 | 62.46 | 96.99 | 2.42 | 80.47 | |
| V^2DropRetain Tokens=1922026.05 | 62.37 | 98.53 | 3.42 | 113.78 | |
| FastVRetain Tokens=1282026.05 | 61.68 | 96.8 | 2.62 | 74.28 | |
| PDropRetain Tokens=1282026.05 | 61.6 | 95.77 | 2.68 | 67.59 | |
| V^2DropRetain Tokens=1282026.05 | 59.28 | 96.2 | 2.59 | 92.8 |