Object Hallucination Evaluation on POPE (dev)
87AccuracyQwen
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| QwenBackbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=100%2025.08 | 87 | 100 | |
| HiPruneBackbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=33.3%2025.08 | 85.9 | 98.7 | |
| HiPrune++Backbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=33.3%2025.08 | 85.9 | 98.7 | |
| VisionZipBackbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=33.3%2025.08 | 85.4 | 97.7 | |
| FastVBackbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=33.3%2025.08 | 85 | 97.4 | |
| HiPruneBackbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=22.2%2025.08 | 84.9 | 97.1 | |
| VisionZipBackbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=22.2%2025.08 | 84.6 | 96.2 | |
| HiPrune++Backbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=22.2%2025.08 | 84.4 | 97.1 | |
| FastVBackbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=22.2%2025.08 | 82.7 | 95.9 | |
| HiPruneBackbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=11.1%2025.08 | 80.4 | 93 | |
| VisionZipBackbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=11.1%2025.08 | 80.2 | 91.5 | |
| HiPrune++Backbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=11.1%2025.08 | 79.9 | 93 | |
| FastVBackbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=11.1%2025.08 | 73.3 | 86.4 |