Science Question Answering on SQA (SQA, Avg %, TFLOPS, Latency)
69.91SQA ScoreLLaVA-v1.5-7B
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| LLaVA-v1.5-7BRetain Tokens=Original2026.05 | 69.91 | 100 | 8.54 | 167.5 | |
| PDropRetain Tokens=1282026.05 | 69.76 | 95.77 | 2.68 | 67.59 | |
| FastVRetain Tokens=1922026.05 | 69.31 | 98.32 | 3.44 | 84.22 | |
| PDropRetain Tokens=2882026.05 | 69.31 | 99.28 | 4.72 | 105.96 | |
| PDropRetain Tokens=1922026.05 | 69.26 | 97.08 | 3.46 | 81.94 | |
| COASTRetain Tokens=2882026.05 | 69.11 | 99.63 | 4.68 | 104.45 | |
| V^2DropRetain Tokens=2882026.05 | 69.06 | 99.59 | 4.68 | 136.4 | |
| COASTRetain Tokens=1922026.05 | 69.01 | 99.79 | 3.44 | 89.93 | |
| V^2DropRetain Tokens=1922026.05 | 68.96 | 98.53 | 3.42 | 113.78 | |
| COASTRetain Tokens=1282026.05 | 68.77 | 98.64 | 2.6 | 77.94 | |
| FastVRetain Tokens=1282026.05 | 68.72 | 96.8 | 2.62 | 74.28 | |
| SparseVLMRetain Tokens=1922026.05 | 68.72 | 98.39 | 3.86 | 92.07 | |
| SparseVLMRetain Tokens=1282026.05 | 68.67 | 97.81 | 2.9 | 68.73 | |
| FastVRetain Tokens=2882026.05 | 68.67 | 99.25 | 4.7 | 125.8 | |
| SparseVLMRetain Tokens=2882026.05 | 68.42 | 99.13 | 5.02 | 109.12 | |
| V^2DropRetain Tokens=1282026.05 | 68.37 | 96.2 | 2.59 | 92.8 | |
| MMTOKRetain Tokens=1282026.05 | 65.53 | 96.99 | 2.42 | 80.47 | |
| MMTOKRetain Tokens=1922026.05 | 65.39 | 97.77 | 3.25 | 94.62 | |
| MMTOKRetain Tokens=2882026.05 | 65.27 | 98.62 | 4.51 | 125.75 |