List your company
ResearchFormerly WizWand

Object Hallucination Evaluation on POPE (dev)

87AccuracyQwen
72.75276.45180.1583.849Aug 1, 2025
Updated 6mo ago

Evaluation results

MethodLinks
QwenBackbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=100%2025.0887100
HiPruneBackbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=33.3%2025.0885.998.7
HiPrune++Backbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=33.3%2025.0885.998.7
VisionZipBackbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=33.3%2025.0885.497.7
FastVBackbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=33.3%2025.088597.4
HiPruneBackbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=22.2%2025.0884.997.1
VisionZipBackbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=22.2%2025.0884.696.2
HiPrune++Backbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=22.2%2025.0884.497.1
FastVBackbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=22.2%2025.0882.795.9
HiPruneBackbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=11.1%2025.0880.493
VisionZipBackbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=11.1%2025.0880.291.5
HiPrune++Backbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=11.1%2025.0879.993
FastVBackbone=Qwen2.5-VL-3B-Instruct, Token Retain Ratio=11.1%2025.0873.386.4