Object Hallucination Probing on GQA Adversarial
83.27AccuracyCAI
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| CAIBackbone=Qwen-VL2026.06 | 83.27 | 83.51 | |
| MESAModel=Qwen-VL2026.04 | 82.73 | 81.93 | |
| SchroMindModel=LLaVA-1.5-7B2026.02 | 81.76 | 82.31 | |
| VCDBackbone=Qwen-VL2026.06 | 81.7 | 82.74 | |
| ICTModel=Qwen-VL2026.04 | 81.61 | 80.75 | |
| ONLYBackbone=Qwen-VL2026.06 | 81.43 | 81.67 | |
| ScalpelBase Model=LLaVA-1.5-7B2026.02 | 81 | 82.09 | |
| ICDModel=Qwen-VL2026.04 | 81 | 80.06 | |
| PAIBackbone=Qwen-VL2026.06 | 80.87 | 80.41 | |
| VTIModel=Qwen-VL2026.04 | 80.47 | 78.44 | |
| VAFModel=Qwen-VL2026.04 | 80.03 | 79.75 | |
| VCDModel=Qwen-VL2026.04 | 80.01 | 80.75 | |
| MESAModel=LLaVA-v1.52026.04 | 79.6 | 81.35 | |
| RegularBackbone=Qwen-VL2026.06 | 79.2 | 78.96 | |
| ICTModel=LLaVA-v1.52026.04 | 79.13 | 81.07 | |
| VAFModel=LLaVA-v1.52026.04 | 79.1 | 80.41 | |
| HDDModel=LLaVA-NeXT2025.12 | 78.4 | 80.5 | |
| VTIModel=LLaVA-v1.52026.04 | 78.33 | 79.78 | |
| CAIBackbone=LLaVA-1.52026.06 | 78.33 | 80.46 | |
| ICTBase Model=LLaVA-1.5-7B2026.02 | 77.4 | 80.11 | |
| ICTModel=LLaVA-1.5-7B2026.02 | 77.4 | 80.11 | |
| RITUALModel=LLaVA-NeXT2025.12 | 77.2 | 78.3 | |
| HDDModel=LLaVA-1.52025.12 | 76.4 | 78.1 | |
| VCDBase Model=LLaVA-1.5-7B2026.02 | 76.09 | 78.78 | |
| VCDModel=LLaVA-1.5-7B2026.02 | 76.09 | 78.78 | |
| VCDModel=LLaVA-v1.52026.04 | 76.09 | 78.78 | |
| CAIBackbone=InstructBLIP2026.06 | 76 | 77.65 | |
| ICDModel=LLaVA-v1.52026.04 | 75.9 | 76.89 | |
| VCDModel=LLaVA-NeXT2025.12 | 75.8 | 76.5 | |
| SamplingModel=LLaVA-NeXT2025.12 | 75.4 | 74.7 | |
| RITUALModel=LLaVA-1.52025.12 | 75.3 | 76.1 | |
| VCDModel=LLaVA-1.52025.12 | 75.2 | 77.7 | |
| VanillaBase Model=LLaVA-1.5-7B2026.02 | 75.08 | 76.06 | |
| RegularModel=LLaVA-1.5-7B2026.02 | 75.08 | 76.06 | |
| OPERABase Model=LLaVA-1.5-7B2026.02 | 75 | 78.71 | |
| OPERAModel=LLaVA-1.5-7B2026.02 | 75 | 78.71 | |
| SamplingModel=LLaVA-1.52025.12 | 74.8 | 75.8 | |
| NulluModel=Qwen-VL2026.04 | 73.61 | 65.59 | |
| VanillaModel=Qwen-VL2026.04 | 73.53 | 65.53 | |
| HDDModel=InstructBLIP2025.12 | 73.5 | 76 | |
| VCDBackbone=InstructBLIP2026.06 | 73.4 | 76.38 | |
| VCDModel=InstructBLIP2025.12 | 73.1 | 76.1 | |
| RITUALModel=InstructBLIP2025.12 | 72.8 | 75.5 | |
| NulluModel=LLaVA-v1.52026.04 | 72.1 | 76.37 | |
| ONLYBackbone=LLaVA-1.52026.06 | 71.5 | 76.75 | |
| SamplingModel=InstructBLIP2025.12 | 70.4 | 74.1 | |
| ONLYBackbone=InstructBLIP2026.06 | 69.37 | 74.92 | |
| AVISCModel=LLaVA-1.5-7B2026.02 | 69.2 | 75.58 | |
| PAIBackbone=InstructBLIP2026.06 | 69.1 | 74.19 | |
| PAIBackbone=LLaVA-1.52026.06 | 69 | 75.34 | |
| VCDBackbone=LLaVA-1.52026.06 | 68.63 | 75.41 | |
| RegularBackbone=InstructBLIP2026.06 | 68.33 | 73.25 | |
| M3IDModel=LLaVA-1.5-7B2026.02 | 68.13 | 74.78 | |
| RegularBackbone=LLaVA-1.52026.06 | 67.93 | 74.35 | |
| VanillaModel=LLaVA-v1.52026.04 | 67.4 | 74.31 |