Caption Hallucination Evaluation on CHAIR
58.8CS ScoreVanilla
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| VanillaDecoding Strategy=Greedy, Model=InstructBLIP2026.06 | 58.8 | 23.7 | — | — | — | — | — | |
| VCDDecoding Strategy=Nucleus, Model=InstructBLIP2026.06 | 58 | 17 | — | — | — | — | — | |
| DoLaDecoding Strategy=Greedy, Model=Qwen3-VL2026.06 | 55.6 | 9.8 | — | — | — | — | — | |
| VanillaDecoding Strategy=Beam, Model=InstructBLIP2026.06 | 55.6 | 15.8 | — | — | — | — | — | |
| DeCoDecoding Strategy=Nucleus, Model=Qwen3-VL2026.06 | 54.8 | 9.9 | — | — | — | — | — | |
| OPERADecoding Strategy=Beam, Model=Qwen3-VL2026.06 | 54.7 | 11.3 | — | — | — | — | — | |
| VanillaDecoding Strategy=Nucleus, Model=InstructBLIP2026.06 | 54.6 | 24.8 | — | — | — | — | — | |
| VanillaDecoding Strategy=Nucleus, Model=Qwen3-VL2026.06 | 54.2 | 10.2 | — | — | — | — | — | |
| VCDDecoding Strategy=Nucleus, Model=LLaVA-1.52026.06 | 54 | 16 | — | — | — | — | — | |
| VanillaDecoding Strategy=Beam, Model=Qwen3-VL2026.06 | 53.6 | 9.7 | — | — | — | — | — | |
| CALRDDecoding Strategy=Nucleus, Model=Qwen3-VL2026.06 | 53.6 | 9.5 | — | — | — | — | — | |
| VCDDecoding Strategy=Nucleus, Model=Qwen3-VL2026.06 | 53.4 | 11 | — | — | — | — | — | |
| RegularSettings=Regular2026.03 | 53 | 13.9 | — | — | — | — | — | |
| Zero-shotModel=LLaVA-1.5-7B, Strategy=Zero-shot2026.05 | 52.8 | 15.8 | 77.9 | — | — | — | — | |
| VanillaDecoding Strategy=Greedy, Model=Qwen3-VL2026.06 | 52.4 | 10.1 | — | — | — | — | — | |
| DeCoDecoding Strategy=Beam, Model=Qwen3-VL2026.06 | 52 | 9.3 | — | — | — | — | — | |
| VCDModel=LLaVA-1.5-7B, Strategy=VCD2026.05 | 51.6 | 15.42 | 77.44 | — | — | — | — | |
| DeCoDecoding Strategy=Greedy, Model=Qwen3-VL2026.06 | 51.2 | 9.6 | — | — | — | — | — | |
| CALRDDecoding Strategy=Greedy, Model=Qwen3-VL2026.06 | 50.7 | 9.3 | — | — | — | — | — | |
| SIDModel=LLaVA-1.5-7B, Strategy=SID2026.05 | 50.6 | 14.2 | 77.94 | — | — | — | — | |
| Antidote→MSCOCOSettings=Antidote→MSCOCO2026.03 | 49.8 | 13.7 | — | — | — | — | — | |
| GreedyBackbone=LLaVA-1.5-7B2026.04 | 49.6 | 14.4 | — | — | — | — | — | |
| GQA→MSCOCOSettings=GQA→MSCOCO2026.03 | 49.5 | 13.2 | — | — | — | — | — | |
| VCDBackbone=LLaVA-1.5-7B2026.04 | 49.2 | 14.8 | — | — | — | — | — | |
| DMASModel=LLaVA-1.5-7B, Strategy=DMAS2026.05 | 48.8 | 14.4 | 77.6 | — | — | — | — | |
| VanillaDecoding Strategy=Beam, Model=LLaVA-1.52026.06 | 48.8 | 13.9 | — | — | — | — | — | |
| VanillaDecoding Strategy=Nucleus, Model=LLaVA-1.52026.06 | 48.8 | 14.2 | — | — | — | — | — | |
| VCDApproach=training-free2026.05 | 48.4 | 23.9 | — | — | — | — | — | |
| DoLaDecoding Strategy=Greedy, Model=InstructBLIP2026.06 | 48.4 | 15.9 | — | — | — | — | — | |
| DoLaDecoding Strategy=Greedy, Model=LLaVA-1.52026.06 | 47.8 | 13.8 | — | — | — | — | — | |
| DoLaBackbone=LLaVA-1.5-7B2026.04 | 47.1 | 13.8 | — | — | — | — | — | |
| SHIFTModel=InstructBLIP, Decoding Strategy=Nucleus2026.06 | 47 | 19.3 | — | — | — | — | — | |
| LTS-FS(Nullu)Settings=LTS-FS(Nullu)2026.03 | 46.8 | 13.5 | — | — | — | — | — | |
| VISTAModel=LLaVA-1.5-7B, Strategy=VISTA2026.05 | 46.4 | 13.28 | 75.74 | — | — | — | — | |
| OPERADecoding Strategy=Beam, Model=InstructBLIP2026.06 | 46.4 | 14.2 | — | — | — | — | — | |
| Beam SearchBackbone=LLaVA-1.5-7B2026.04 | 46.3 | 12.9 | — | — | — | — | — | |
| Training-Free Debiasing Inference StrategyModel=LLaVA-1.5-7B, Strategy=Ours2026.05 | 45.6 | 12.99 | 75.11 | — | — | — | — | |
| OPERAApproach=training-free2026.05 | 45.6 | 22.8 | — | — | — | — | — | |
| OPERABackbone=LLaVA-1.5-7B2026.04 | 45.4 | 12.7 | — | — | — | — | — | |
| VanillaDecoding Strategy=Greedy, Model=LLaVA-1.52026.06 | 45 | 14.7 | — | — | — | — | — | |
| OPERADecoding Strategy=Beam, Model=LLaVA-1.52026.06 | 44.6 | 12.8 | — | — | — | — | — | |
| SIDBackbone=LLaVA-1.5-7B2026.04 | 44.2 | 12.2 | — | — | — | — | — | |
| SHIFTModel=InstructBLIP, Decoding Strategy=Greedy2026.06 | 44 | 19.9 | — | — | — | — | — | |
| DeCoDecoding Strategy=Beam, Model=InstructBLIP2026.06 | 43.8 | 12.7 | — | — | — | — | — | |
| SHIFTModel=LLaVA-1.5, Decoding Strategy=Greedy2026.06 | 43.8 | 12.4 | — | — | — | — | — | |
| DeCoDecoding Strategy=Nucleus, Model=InstructBLIP2026.06 | 43.6 | 12.9 | — | — | — | — | — | |
| VCDDecoding Strategy=Nucleus, Model=Qwen2.5-VL2026.06 | 42.9 | 12.3 | — | — | — | — | — | |
| DeCoDecoding Strategy=Nucleus, Model=LLaVA-1.52026.06 | 42.8 | 13.2 | — | — | — | — | — | |
| CALRDDecoding Strategy=Nucleus, Model=InstructBLIP2026.06 | 42.7 | 12.1 | — | — | — | — | — | |
| CALRDModel=InstructBLIP, Decoding Strategy=Nucleus2026.06 | 42.7 | 12.1 | — | — | — | — | — | |
| SHIFTModel=LLaVA-1.5, Decoding Strategy=Nucleus2026.06 | 42 | 11.6 | — | — | — | — | — | |
| DeCoDecoding Strategy=Greedy, Model=InstructBLIP2026.06 | 41.2 | 14.4 | — | — | — | — | — | |
| VCDDecoding Strategy=Nucleus, Model=LLaVA-1.62026.06 | 41.2 | 10.2 | — | — | — | — | — | |
| VanillaDecoding Strategy=Greedy, Model=Qwen2.5-VL2026.06 | 40.8 | 9.7 | — | — | — | — | — | |
| CALRDDecoding Strategy=Beam, Model=Qwen3-VL2026.06 | 40.6 | 7.9 | — | — | — | — | — | |
| VanillaDecoding Strategy=Nucleus, Model=Qwen2.5-VL2026.06 | 40.4 | 10.7 | — | — | — | — | — | |
| DeCoDecoding Strategy=Nucleus, Model=Qwen2.5-VL2026.06 | 40.4 | 9.5 | — | — | — | — | — | |
| CALRDDecoding Strategy=Greedy, Model=InstructBLIP2026.06 | 40.2 | 14.6 | — | — | — | — | — | |
| CALRDModel=InstructBLIP, Decoding Strategy=Greedy2026.06 | 40.2 | 14.6 | — | — | — | — | — | |
| LLaVA-NeXTModel=LLaVA-NeXT2026.05 | 40 | 10.5 | — | — | — | — | — | |
| OPERADecoding Strategy=Beam, Model=Qwen2.5-VL2026.06 | 39.1 | 10.2 | — | — | — | — | — | |
| SHIFTModel=InstructBLIP, Decoding Strategy=Beam2026.06 | 39 | 13.3 | — | — | — | — | — | |
| VanillaDecoding Strategy=Beam, Model=Qwen2.5-VL2026.06 | 38.9 | 9.4 | — | — | — | — | — | |
| EAZYBackbone=LLaVA-1.5-7B2026.04 | 38.8 | 11.4 | — | — | — | — | — | |
| CALRDDecoding Strategy=Nucleus, Model=Qwen2.5-VL2026.06 | 38.6 | 9.1 | — | — | — | — | — | |
| CALRDDecoding Strategy=Beam, Model=InstructBLIP2026.06 | 38.4 | 11.4 | — | — | — | — | — | |
| CALRDModel=InstructBLIP, Decoding Strategy=Beam2026.06 | 38.4 | 11.4 | — | — | — | — | — | |
| DeCoDecoding Strategy=Beam, Model=Qwen2.5-VL2026.06 | 38.2 | 8.5 | — | — | — | — | — | |
| DeCoDecoding Strategy=Greedy, Model=LLaVA-1.52026.06 | 37.8 | 11.1 | — | — | — | — | — | |
| VanillaDecoding Strategy=Greedy, Model=LLaVA-1.62026.06 | 37.6 | 12.7 | — | — | — | — | — | |
| DeCoDecoding Strategy=Greedy, Model=Qwen2.5-VL2026.06 | 37.6 | 9.1 | — | — | — | — | — | |
| CALRDDecoding Strategy=Nucleus, Model=LLaVA-1.52026.06 | 37.6 | 12.8 | — | — | — | — | — | |
| CALRDModel=LLaVA-1.5, Decoding Strategy=Nucleus2026.06 | 37.6 | 12.8 | — | — | — | — | — | |
| DAMOBase Model=Qwen2.5-VL-7B-Instruct2026.06 | 37.6 | 7.1 | — | — | — | — | — | |
| DCLABase Model=Qwen2.5-VL-7B-Instruct2026.06 | 37.4 | 7.6 | — | — | — | — | — | |
| InternVL2-8BModel=InternVL2-8B2026.05 | 37.2 | 9.4 | — | — | — | — | — | |
| Qwen2.5-VL-7BModel=Qwen2.5-VL-7B2026.05 | 37.2 | 8.7 | — | — | — | — | — | |
| PAIBase Model=Qwen2.5-VL-7B-Instruct2026.06 | 37.2 | 8.4 | — | — | — | — | — | |
| VanillaDecoding Strategy=Nucleus, Model=LLaVA-1.62026.06 | 36.8 | 10.5 | — | — | — | — | — | |
| SHIFTModel=LLaVA-1.5, Decoding Strategy=Beam2026.06 | 36.7 | 10.5 | — | — | — | — | — | |
| GreedyBase Model=Qwen2.5-VL-7B-Instruct2026.06 | 36.6 | 9.5 | — | — | — | — | — | |
| FADEBase Model=Qwen2.5-VL-7B-Instruct2026.06 | 36.6 | 9.5 | — | — | — | — | — | |
| DoLaDecoding Strategy=Greedy, Model=Qwen2.5-VL2026.06 | 36.5 | 9.2 | — | — | — | — | — | |
| DeCoDecoding Strategy=Nucleus, Model=LLaVA-1.62026.06 | 36.1 | 10.1 | — | — | — | — | — | |
| VanillaDecoding Strategy=Beam, Model=LLaVA-1.62026.06 | 36 | 12.1 | — | — | — | — | — | |
| DAIDBackbone=LLaVA-1.5-7B2026.04 | 35.9 | 11.3 | — | — | — | — | — | |
| DeCoDecoding Strategy=Greedy, Model=LLaVA-1.62026.06 | 35.8 | 10.4 | — | — | — | — | — | |
| CALRDDecoding Strategy=Greedy, Model=LLaVA-1.52026.06 | 35.7 | 10.3 | — | — | — | — | — | |
| CALRDModel=LLaVA-1.5, Decoding Strategy=Greedy2026.06 | 35.7 | 10.3 | — | — | — | — | — | |
| CALRDDecoding Strategy=Greedy, Model=Qwen2.5-VL2026.06 | 35.5 | 9.5 | — | — | — | — | — | |
| DoLaDecoding Strategy=Greedy, Model=LLaVA-1.62026.06 | 35.3 | 8.7 | — | — | — | — | — | |
| OPERADecoding Strategy=Beam, Model=LLaVA-1.62026.06 | 35.3 | 12.9 | — | — | — | — | — | |
| Zero-shotModel=Qwen2.5-VL-7B, Strategy=Zero-shot2026.05 | 35.24 | 10.4 | 67.1 | — | — | — | — | |
| CALRDDecoding Strategy=Nucleus, Model=LLaVA-1.62026.06 | 34.8 | 11.5 | — | — | — | — | — | |
| CALRDDecoding Strategy=Beam, Model=LLaVA-1.52026.06 | 34.7 | 10.9 | — | — | — | — | — | |
| CALRDModel=LLaVA-1.5, Decoding Strategy=Beam2026.06 | 34.7 | 10.9 | — | — | — | — | — | |
| DeCoDecoding Strategy=Beam, Model=LLaVA-1.62026.06 | 34.4 | 9 | — | — | — | — | — | |
| OPERABackbone=LLaVA-NeXT2026.04 | 34 | 8.7 | — | — | — | — | — | |
| CALRDDecoding Strategy=Greedy, Model=LLaVA-1.62026.06 | 33.6 | 9.3 | — | — | — | — | — | |
| CALRDDecoding Strategy=Beam, Model=Qwen2.5-VL2026.06 | 33.4 | 8.2 | — | — | — | — | — |