Driving VQA on DriveLM (test)
81AccuracyVanilla
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| VanillaTokens per image=729, Reduction rate=100%2025.08 | 81 | 65.44 | 61 | 74 | 19 | 33.9 | 59.1 | |
| Prune2DriveTokens per image=180, Reduction rate=↓ 75%2025.08 | 80 | 64.92 | 60 | 75 | 20 | 34 | 58.3 | |
| SparseVLMTokens per image=180, Reduction rate=↓ 75%2025.08 | 79 | 63.74 | 57 | 73 | 19 | 33.4 | 57.4 | |
| DARTTokens per image=180, Reduction rate=↓ 75%2025.08 | 78 | 64.02 | 56 | 73 | 18 | 33.6 | 57.2 | |
| PACTTokens per image=180, Reduction rate=↓ 75%2025.08 | 78 | 64.24 | 56 | 73 | 19 | 33.3 | 57.3 | |
| Prune2DriveTokens per image=72, Reduction rate=↓ 90%2025.08 | 78 | 64.52 | 56 | 74 | 16 | 33.4 | 57.4 | |
| FastVTokens per image=180, Reduction rate=↓ 75%2025.08 | 77 | 63.95 | 54 | 72 | 15 | 32.8 | 56.6 | |
| PACTTokens per image=72, Reduction rate=↓ 90%2025.08 | 76 | 64.76 | 54 | 73 | 15 | 32.9 | 56.8 | |
| SparseVLMTokens per image=72, Reduction rate=↓ 90%2025.08 | 75 | 63.38 | 52 | 72 | 15 | 32.9 | 55.9 | |
| DARTTokens per image=72, Reduction rate=↓ 90%2025.08 | 69 | 64.2 | 51 | 71 | 12 | 32 | 54.7 | |
| FastVTokens per image=72, Reduction rate=↓ 90%2025.08 | 68 | 63.52 | 49 | 71 | 8 | 32.3 | 54.1 |