Object Hallucination Evaluation on POPE (Latency Metrics)
64Inference (ms)ASAP
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ASAPTokens=642026.05 | 64 | 35 | 85.7 | |
| VisionZipTokens=642026.05 | 77 | 39 | 77 | |
| PruneSIDTokens=642026.05 | 78 | 41 | 84.1 | |
| SparseVLMTokens=642026.05 | 81 | 48 | 75.1 | |
| ASAPTokens=1602026.05 | 98 | 78 | 81.6 | |
| VisionZipTokens=1602026.05 | 115 | 89 | 74.8 | |
| LLaVA (Full)Tokens=5762026.05 | 120 | 79 | 85.9 | |
| PruneSIDTokens=1602026.05 | 123 | 105 | 76.9 | |
| LLaVA-NeXT (Full)Tokens=28802026.05 | 268 | 234 | 86.4 |