Object Hallucination Evaluation on POPE GQA (test)
84.72Average AccuracyLLaVA-1.5 + HIRE
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| LLaVA-1.5 + HIREBase Model=LLaVA-1.5, Strategy=HIRE2026.03 | 84.72 | 88.87 | 89.21 | 84.67 | 85.21 | 80.63 | 82.07 | 85.5 | |
| LLaVA-1.5 + AVISCBase Model=LLaVA-1.5, Strategy=AVISC2026.03 | 83.7 | 87.4 | 86.21 | 83.33 | 82.54 | 80.37 | 80 | 82.92 | |
| SVCBase MLLM=LLaVA-1.52026.03 | 81.54 | — | — | — | — | — | — | 83.38 | |
| SVCBase MLLM=Shikra2026.03 | 81.24 | — | — | — | — | — | — | 81.44 | |
| VISTABase MLLM=LLaVA-1.52026.03 | 80.89 | — | — | — | — | — | — | 82.37 | |
| ONLYBase MLLM=LLaVA-1.52026.03 | 80.44 | — | — | — | — | — | — | 82.17 | |
| ONLYBase MLLM=Shikra2026.03 | 80.28 | — | — | — | — | — | — | 81.02 | |
| LLaVA-1.5 + VCDBase Model=LLaVA-1.5, Strategy=Contrastive Decoding2026.03 | 80.25 | 85.63 | 85.38 | 78.73 | 79.78 | 76.4 | 78.15 | 81.1 | |
| LLaVA-1.5Base Model=LLaVA-1.52026.03 | 80.08 | 84.8 | 84.16 | 79.37 | 79.64 | 76 | 76.89 | 80.23 | |
| LLaVA-1.5 + M3IDBase Model=LLaVA-1.5, Strategy=M3ID2026.03 | 79.95 | 84.8 | 84.23 | 79.23 | 79.63 | 75.83 | 76.93 | 80.26 | |
| PAIBase MLLM=LLaVA-1.52026.03 | 79.8 | — | — | — | — | — | — | 81.12 | |
| VISTABase MLLM=Shikra2026.03 | 79.59 | — | — | — | — | — | — | 80.2 | |
| VCDBase MLLM=LLaVA-1.52026.03 | 79.36 | — | — | — | — | — | — | 80.92 | |
| PAIBase MLLM=Shikra2026.03 | 79.23 | — | — | — | — | — | — | 80.16 | |
| VCDBase MLLM=Shikra2026.03 | 78.89 | — | — | — | — | — | — | 79.96 | |
| VanillaBase MLLM=LLaVA-1.52026.03 | 78.76 | — | — | — | — | — | — | 80.79 | |
| VanillaBase MLLM=Shikra2026.03 | 78.59 | — | — | — | — | — | — | 79.7 | |
| SVCBase MLLM=InstructBLIP2026.03 | 78.11 | — | — | — | — | — | — | 80.29 | |
| VISTABase MLLM=InstructBLIP2026.03 | 78.01 | — | — | — | — | — | — | 80.34 | |
| ONLYBase MLLM=InstructBLIP2026.03 | 77.98 | — | — | — | — | — | — | 80.32 | |
| PAIBase MLLM=InstructBLIP2026.03 | 77.56 | — | — | — | — | — | — | 79.18 | |
| VanillaBase MLLM=InstructBLIP2026.03 | 77.31 | — | — | — | — | — | — | 79.08 | |
| VCDBase MLLM=InstructBLIP2026.03 | 77.11 | — | — | — | — | — | — | 78.98 | |
| ONLYBase MLLM=MiniGPT-42026.03 | 71.99 | — | — | — | — | — | — | 73.89 | |
| SVCBase MLLM=MiniGPT-42026.03 | 71.4 | — | — | — | — | — | — | 73.37 | |
| VISTABase MLLM=MiniGPT-42026.03 | 71.13 | — | — | — | — | — | — | 73.19 | |
| PAIBase MLLM=MiniGPT-42026.03 | 71.12 | — | — | — | — | — | — | 73.2 | |
| VanillaBase MLLM=MiniGPT-42026.03 | 70.81 | — | — | — | — | — | — | 73.08 | |
| VCDBase MLLM=MiniGPT-42026.03 | 70.6 | — | — | — | — | — | — | 72.98 | |
| DAMOModel=LLaVA1.5, Decoding Strategy=DAMO2025.08 | — | 87.5 | 88.58 | 76.17 | 80.28 | 70.07 | 76.42 | — | |
| DAMOModel=mPLUG2, Decoding Strategy=DAMO2025.08 | — | 87.03 | 86.38 | 79.67 | 80.18 | 77.97 | 78.88 | — | |
| DAMOModel=InstBLIP, Decoding Strategy=DAMO2025.08 | — | 87 | 87.47 | 75.03 | 78.42 | 72.13 | 76.5 | — | |
| DCLAModel=LLaVA1.5, Decoding Strategy=DCLA2025.08 | — | 87.9 | 88.94 | 75.2 | 79.68 | 69.13 | 75.91 | — | |
| DCLAModel=mPLUG2, Decoding Strategy=DCLA2025.08 | — | 87.07 | 86.98 | 78.9 | 80.37 | 76.77 | 78.81 | — | |
| DCLAModel=InstBLIP, Decoding Strategy=DCLA2025.08 | — | 87.47 | 87.65 | 75.93 | 78.7 | 73 | 76.71 | — | |
| HGAIModel=LLaVA1.5, Decoding Strategy=HGAI2025.08 | — | 87.07 | 88.24 | 74.37 | 79.1 | 69.2 | 75.9 | — | |
| HGAIModel=mPLUG2, Decoding Strategy=HGAI2025.08 | — | 86.9 | 86.15 | 79.63 | 80 | 78.03 | 78.76 | — | |
| HGAIModel=InstBLIP, Decoding Strategy=HGAI2025.08 | — | 87.3 | 86.99 | 75.57 | 77.66 | 74.03 | 76.68 | — | |
| MAPModel=LLaVA1.5, Decoding Strategy=MAP2025.08 | — | 88.57 | 89.32 | 77.9 | 81.22 | 72.57 | 77.7 | — | |
| MAPModel=mPLUG2, Decoding Strategy=MAP2025.08 | — | 86.93 | 86.31 | 80.13 | 80.33 | 78.57 | 79.1 | — | |
| MAPModel=InstBLIP, Decoding Strategy=MAP2025.08 | — | 87.57 | 87.69 | 76.53 | 79.06 | 73.83 | 77.2 | — | |
| SPINModel=LLaVA1.5, Decoding Strategy=SPIN2025.08 | — | 87.53 | 88.66 | 75.27 | 79.76 | 68.87 | 76.43 | — | |
| SPINModel=mPLUG2, Decoding Strategy=SPIN2025.08 | — | 86.1 | 85.4 | 79.8 | 80.11 | 78.13 | 78.81 | — | |
| SPINModel=InstBLIP, Decoding Strategy=SPIN2025.08 | — | 86.7 | 86.04 | 76.2 | 79.15 | 71.37 | 75.93 | — | |
| VanillaModel=LLaVA1.5, Decoding Strategy=Vanilla2025.08 | — | 86.5 | 87.83 | 74.73 | 79.45 | 68.77 | 75.73 | — | |
| VanillaModel=mPLUG2, Decoding Strategy=Vanilla2025.08 | — | 86.56 | 87.2 | 80.23 | 80.67 | 78.43 | 79.27 | — | |
| VanillaModel=InstBLIP, Decoding Strategy=Vanilla2025.08 | — | 86.93 | 87.34 | 76.47 | 79.3 | 71.6 | 76.04 | — | |
| VCDModel=LLaVA1.5, Decoding Strategy=VCD2025.08 | — | 86 | 87.33 | 74.5 | 79.29 | 68.1 | 75.15 | — | |
| VCDModel=mPLUG2, Decoding Strategy=VCD2025.08 | — | 84.87 | 84.08 | 77.6 | 78 | 75.7 | 76.38 | — | |
| VCDModel=InstBLIP, Decoding Strategy=VCD2025.08 | — | 81.43 | 81.6 | 73.73 | 75.81 | 71.93 | 74.8 | — |