Object Hallucination Evaluation on A-OKVQA POPE
92.37Random AccuracyDAC
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| DACModel=LLaVA-NeXT, Decoding strategy=greedy decoding2025.02 | 92.37 | 92.47 | 89.13 | 89.62 | 78.8 | 81.56 | — | — | |
| BaselineModel=LLaVA-NeXT, Decoding strategy=greedy decoding2025.02 | 91.8 | 92.07 | 87.17 | 88.13 | 77.47 | 80.87 | — | — | |
| VCDModel=LLaVA-NeXT, Decoding strategy=greedy decoding2025.02 | 91.8 | 92.07 | 87.2 | 88.15 | 77.53 | 80.9 | — | — | |
| OPERAModel=LLaVA-NeXT, Decoding strategy=beam search2025.02 | 91.77 | 92.03 | 87.2 | 88.15 | 77.21 | 80.62 | — | — | |
| SIDModel=LLaVA-NeXT, Decoding strategy=greedy decoding2025.02 | 91.73 | 92.01 | 86.87 | 87.88 | 77.33 | 80.77 | — | — | |
| CCAModel=LLaVA-1.5, Decoding strategy=greedy decoding2025.02 | 90 | 90.11 | 85.45 | 85.01 | 74.77 | 78.32 | — | — | |
| DACModel=LLaVA-1.5, Decoding strategy=greedy decoding2025.02 | 89.7 | 90.33 | 83.96 | 85.52 | 75.42 | 79.21 | — | — | |
| LLaVA-1.5 + HIREBase Model=LLaVA-1.5, Strategy=HIRE2026.03 | 88.9 | 89.2 | 86.5 | 86.52 | 78.07 | 79.7 | 84.49 | 85.14 | |
| LLaVA-1.5 + AVISCBase Model=LLaVA-1.5, Strategy=AVISC2026.03 | 87.33 | 86.14 | 85.03 | 84.03 | 79.27 | 79.16 | 83.88 | 83.11 | |
| BaselineModel=LLaVA-1.5, Decoding strategy=greedy decoding2025.02 | 87.3 | 88.49 | 80.3 | 83.21 | 69.33 | 76.1 | — | — | |
| SIDModel=LLaVA-1.5, Decoding strategy=greedy decoding2025.02 | 87.3 | 88 | 82 | 83.8 | 72.93 | 77.48 | — | — | |
| OPERAModel=LLaVA-1.5, Decoding strategy=beam search2025.02 | 87.27 | 88.5 | 80.47 | 83.38 | 69.2 | 76.09 | — | — | |
| DACModel=mPLUG-Owl2, Decoding strategy=greedy decoding2025.02 | 86.56 | 87.24 | 82.83 | 83.47 | 75.88 | 77.78 | — | — | |
| LLaVA-1.5 + VCDBase Model=LLaVA-1.5, Strategy=Contrastive Decoding2026.03 | 85.53 | 85.12 | 81.17 | 81.46 | 75.03 | 76.72 | 80.58 | 81.1 | |
| LLaVA-1.5 + M3IDBase Model=LLaVA-1.5, Strategy=M3ID2026.03 | 85.06 | 84.3 | 80.9 | 80.77 | 74.8 | 76.15 | 80.25 | 80.41 | |
| VCDModel=LLaVA-1.5, Decoding strategy=greedy decoding2025.02 | 85 | 86.49 | 77.5 | 81.07 | 67.9 | 75.01 | — | — | |
| LLaVA-1.5Base Model=LLaVA-1.52026.03 | 84.93 | 84.07 | 80.9 | 80.64 | 74.8 | 75.59 | 80.21 | 80.1 | |
| SIDModel=mPLUG-Owl2, Decoding strategy=greedy decoding2025.02 | 83.53 | 85.28 | 77.47 | 80.89 | 68.93 | 75.43 | — | — | |
| VCDModel=mPLUG-Owl2, Decoding strategy=greedy decoding2025.02 | 82.53 | 84.16 | 75.7 | 79.21 | 68.8 | 74.85 | — | — | |
| BaselineModel=mPLUG-Owl2, Decoding strategy=greedy decoding2025.02 | 81.57 | 83.89 | 75.97 | 79.98 | 67.37 | 74.63 | — | — | |
| OPERAModel=mPLUG-Owl2, Decoding strategy=beam search2025.02 | 81.53 | 83.86 | 75.93 | 79.94 | 67.3 | 74.58 | — | — |