Object Hallucination Probing on COCO POPE Random
90.67AccuracyScalpel
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ScalpelBase Model=LLaVA-1.5-7B2026.02 | 90.67 | — | — | — | — | — | — | — | — | — | 90.74 | |
| ICTModel=LLaVA-v1.52024.11 | 90.11 | — | — | — | — | — | — | — | — | — | 90.03 | |
| ICT w/o imageModel=LLaVA-v1.52024.11 | 89.7 | — | — | — | — | — | — | — | — | — | 89.93 | |
| ICTModel=Qwen-VL2024.11 | 89.46 | — | — | — | — | — | — | — | — | — | 89.2 | |
| OPERAModel=LLaVA-v1.52024.11 | 89.2 | — | — | — | — | — | — | — | — | — | 88.81 | |
| OPERABase Model=LLaVA-1.5-7B2026.02 | 89.2 | — | — | — | — | — | — | — | — | — | 88.81 | |
| ICT w/o objectModel=Qwen-VL2024.11 | 89.13 | — | — | — | — | — | — | — | — | — | 88.2 | |
| ICTBase Model=LLaVA-1.5-7B2026.02 | 89.1 | — | — | — | — | — | — | — | — | — | 88.48 | |
| ICT w/o imageModel=Qwen-VL2024.11 | 88.76 | — | — | — | — | — | — | — | — | — | 87.84 | |
| VCDModel=Qwen-VL2024.11 | 88.63 | — | — | — | — | — | — | — | — | — | 87.81 | |
| ICT w/o objectModel=LLaVA-v1.52024.11 | 88.5 | — | — | — | — | — | — | — | — | — | 88.81 | |
| VCDModel=LLaVA-v1.52024.11 | 87.73 | — | — | — | — | — | — | — | — | — | 87.16 | |
| VCDBase Model=LLaVA-1.5-7B2026.02 | 87.73 | — | — | — | — | — | — | — | — | — | 87.16 | |
| OPERAModel=Qwen-VL2024.11 | 87.31 | — | — | — | — | — | — | — | — | — | 86.92 | |
| RegularModel=Qwen-VL2024.11 | 84.37 | — | — | — | — | — | — | — | — | — | 82.67 | |
| RegularModel=LLaVA-v1.52024.11 | 83.29 | — | — | — | — | — | — | — | — | — | 81.33 | |
| VanillaBase Model=LLaVA-1.5-7B2026.02 | 83.29 | — | — | — | — | — | — | — | — | — | 81.33 | |
| BaselineBackbone=LLaVA-1.52025.06 | — | 88.5 | 81 | 63.03 | 72.33 | 78.97 | 72.23 | — | — | 73.51 | — | |
| BaselineBackbone=Qwen-VL-Chat2025.06 | — | 86.63 | 84.57 | 68.13 | 76.83 | — | — | 56.97 | 77.53 | 72.81 | — | |
| CLAIMBackbone=LLaVA-1.52025.06 | — | 86.5 | 87.33 | 87.5 | 85.4 | 80.5 | — | — | — | 85.45 | — | |
| CLAIMBackbone=Qwen-VL-Chat2025.06 | — | 88.03 | 86.93 | 82.6 | 67.57 | — | — | 88.07 | — | 82.64 | — | |
| VCDBackbone=LLaVA-1.52025.06 | — | — | 81.47 | 67.4 | 73.33 | 78.07 | 72.47 | — | — | 74.55 | — | |
| VCDBackbone=Qwen-VL-Chat2025.06 | — | — | 84.7 | 72.17 | 75.37 | — | — | 48.37 | 78.27 | 71.78 | — |