Object Hallucination Evaluation on POPE (Accuracy, F1, Precision, Recall)
90.81AccuracyVISE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| VISEModel=Qwen3-VL-32B-Instruct2026.06 | 90.81 | 89.92 | 93.45 | 86.65 | |
| VisionZero-CLEVRModel=Qwen3-VL-32B-Instruct2026.06 | 90.73 | 89.86 | 93.39 | 86.59 | |
| VisionZero-RWModel=Qwen3-VL-32B-Instruct2026.06 | 90.66 | 89.8 | 93.31 | 86.54 | |
| EvoLMMModel=Qwen3-VL-32B-Instruct2026.06 | 90.59 | 89.72 | 93.23 | 86.46 | |
| VisionZero-ChartModel=Qwen3-VL-32B-Instruct2026.06 | 90.51 | 89.64 | 93.14 | 86.39 | |
| VisPlayModel=Qwen3-VL-32B-Instruct2026.06 | 90.45 | 89.57 | 93.07 | 86.32 | |
| iReasonerModel=Qwen3-VL-32B-Instruct2026.06 | 90.39 | 89.49 | 92.95 | 86.28 | |
| BaseModel=Qwen3-VL-32B-Instruct2026.06 | 90.35 | 89.45 | 92.96 | 86.2 | |
| VISEModel=Qwen3-VL-8B-Instruct2026.06 | 90.32 | 89.32 | 92.73 | 86.15 | |
| VisPlayModel=Qwen3-VL-8B-Instruct2026.06 | 90.23 | 89.15 | 92.73 | 85.84 | |
| VisionZero-CLEVRModel=Qwen3-VL-8B-Instruct2026.06 | 90.18 | 89.06 | 92.72 | 85.68 | |
| EvoLMMModel=Qwen3-VL-8B-Instruct2026.06 | 90.13 | 88.98 | 92.73 | 85.52 | |
| iReasonerModel=Qwen3-VL-8B-Instruct2026.06 | 90.07 | 88.89 | 92.72 | 85.36 | |
| VISEModel=Qwen3-VL-2B-Instruct2026.06 | 90.03 | 89.22 | 93.13 | 85.63 | |
| VisionZero-RWModel=Qwen3-VL-8B-Instruct2026.06 | 90.02 | 88.8 | 92.72 | 85.2 | |
| VisionZero-ChartModel=Qwen3-VL-8B-Instruct2026.06 | 89.95 | 88.69 | 92.7 | 85.01 | |
| BaseModel=Qwen3-VL-8B-Instruct2026.06 | 89.91 | 88.61 | 92.71 | 84.86 | |
| VISEModel=Qwen3-VL-4B-Instruct2026.06 | 89.86 | 88.98 | 92.47 | 85.74 | |
| VisionZero-CLEVRModel=Qwen3-VL-4B-Instruct2026.06 | 89.82 | 88.02 | 93.71 | 82.98 | |
| BaseModel=Qwen3-VL-4B-Instruct2026.06 | 89.73 | 88.45 | 92.57 | 84.68 | |
| VisionZero-RWModel=Qwen3-VL-4B-Instruct2026.06 | 89.67 | 89.25 | 93.8 | 85.12 | |
| VisionZero-CLEVRModel=Qwen3-VL-2B-Instruct2026.06 | 89.65 | 89.01 | 93.09 | 85.27 | |
| iReasonerModel=Qwen3-VL-4B-Instruct2026.06 | 89.64 | 88.59 | 93.15 | 84.46 | |
| EvoLMMModel=Qwen3-VL-4B-Instruct2026.06 | 89.53 | 88.56 | 93.07 | 84.39 | |
| VisPlayModel=Qwen3-VL-4B-Instruct2026.06 | 89.42 | 88.92 | 92.89 | 84.99 | |
| VisionZero-ChartModel=Qwen3-VL-2B-Instruct2026.06 | 89.35 | 88.75 | 91.86 | 85.84 | |
| VisPlayModel=Qwen3-VL-2B-Instruct2026.06 | 89.32 | 88.72 | 92.86 | 84.93 | |
| BaseModel=Qwen3-VL-2B-Instruct2026.06 | 89.01 | 88.37 | 92.45 | 84.63 | |
| VisionZero-ChartModel=Qwen3-VL-4B-Instruct2026.06 | 88.75 | 88.77 | 92.79 | 84.93 | |
| VisionZero-RWModel=Qwen3-VL-2B-Instruct2026.06 | 88.7 | 87.84 | 93.05 | 83.18 | |
| iReasonerModel=Qwen3-VL-2B-Instruct2026.06 | 87.7 | 88.56 | 92.12 | 85.26 | |
| EvoLMMModel=Qwen3-VL-2B-Instruct2026.06 | 87.59 | 88.51 | 92.05 | 85.17 |