Diagram Understanding on AI2D (Accuracy and Efficiency Metrics)
55.38AI2D AccuracyV^2Drop
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| V^2DropRetain Tokens=2882026.05 | 55.38 | 99.59 | 4.68 | 136.4 | |
| COASTRetain Tokens=1922026.05 | 55.34 | 99.79 | 3.44 | 89.93 | |
| LLaVA-v1.5-7BRetain Tokens=Original2026.05 | 55.21 | 100 | 8.54 | 167.5 | |
| FastVRetain Tokens=2882026.05 | 55.12 | 99.25 | 4.7 | 125.8 | |
| COASTRetain Tokens=2882026.05 | 54.99 | 99.63 | 4.68 | 104.45 | |
| PDropRetain Tokens=2882026.05 | 54.92 | 99.28 | 4.72 | 105.96 | |
| SparseVLMRetain Tokens=2882026.05 | 54.92 | 99.13 | 5.02 | 109.12 | |
| MMTOKRetain Tokens=2882026.05 | 54.92 | 98.62 | 4.51 | 125.75 | |
| MMTOKRetain Tokens=1922026.05 | 54.89 | 97.77 | 3.25 | 94.62 | |
| V^2DropRetain Tokens=1922026.05 | 54.73 | 98.53 | 3.42 | 113.78 | |
| SparseVLMRetain Tokens=1282026.05 | 54.57 | 97.81 | 2.9 | 68.73 | |
| COASTRetain Tokens=1282026.05 | 54.57 | 98.64 | 2.6 | 77.94 | |
| SparseVLMRetain Tokens=1922026.05 | 54.53 | 98.39 | 3.86 | 92.07 | |
| MMTOKRetain Tokens=1282026.05 | 54.11 | 96.99 | 2.42 | 80.47 | |
| FastVRetain Tokens=1922026.05 | 53.95 | 98.32 | 3.44 | 84.22 | |
| V^2DropRetain Tokens=1282026.05 | 53.63 | 96.2 | 2.59 | 92.8 | |
| FastVRetain Tokens=1282026.05 | 53.59 | 96.8 | 2.62 | 74.28 | |
| PDropRetain Tokens=1282026.05 | 53.43 | 95.77 | 2.68 | 67.59 | |
| PDropRetain Tokens=1922026.05 | 53.3 | 97.08 | 3.46 | 81.94 |