Object Hallucination Probing on Style-POPE Adversarial
75.2AccuracyDola
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| DolaStyle=Original, Base Model=InstructBLIP2025.08 | 75.2 | 90.4 | 56.3 | 69.4 | |
| SAVERStyle=Original, Base Model=LLaVA-1.52025.08 | 73.9 | 67.3 | 92.8 | 78 | |
| SAVERStyle=Original, Base Model=InstructBLIP2025.08 | 73.6 | 69.8 | 83 | 75.8 | |
| DolaStyle=Game, Base Model=InstructBLIP2025.08 | 72.6 | 90.8 | 50.3 | 64.8 | |
| DecoStyle=Original, Base Model=InstructBLIP2025.08 | 72.6 | 68 | 85.6 | 75.8 | |
| SAVERStyle=Sketch, Base Model=LLaVA-1.52025.08 | 72.1 | 66.8 | 87.7 | 75.8 | |
| DolaStyle=Average, Base Model=InstructBLIP2025.08 | 71.6 | 90.3 | 48.45 | 62.93 | |
| DolaStyle=Painting, Base Model=InstructBLIP2025.08 | 71.4 | 90.7 | 47.7 | 62.5 | |
| SAVERStyle=Average, Base Model=LLaVA-1.52025.08 | 71.07 | 65.68 | 88.22 | 75.27 | |
| DolaStyle=Cartoon, Base Model=InstructBLIP2025.08 | 70.9 | 87.8 | 48.7 | 62.6 | |
| SAVERStyle=Sketch, Base Model=InstructBLIP2025.08 | 70.8 | 67.1 | 81.4 | 73.6 | |
| SAVERStyle=Painting, Base Model=LLaVA-1.52025.08 | 70.8 | 66 | 85.6 | 74.5 | |
| SAVERStyle=Game, Base Model=LLaVA-1.52025.08 | 70.2 | 65 | 87.7 | 74.6 | |
| SAVERStyle=Cartoon, Base Model=LLaVA-1.52025.08 | 70.1 | 64.8 | 88.1 | 74.7 | |
| DolaStyle=Graffiti, Base Model=InstructBLIP2025.08 | 69.9 | 90.2 | 44.8 | 59.8 | |
| DecoStyle=Sketch, Base Model=InstructBLIP2025.08 | 69.9 | 65.1 | 86 | 74.1 | |
| DolaStyle=Sketch, Base Model=InstructBLIP2025.08 | 69.6 | 91.9 | 42.9 | 58.5 | |
| SAVERStyle=Average, Base Model=InstructBLIP2025.08 | 69.45 | 64.98 | 84.82 | 73.53 | |
| SAVERStyle=Graffiti, Base Model=LLaVA-1.52025.08 | 69.3 | 64.2 | 87.4 | 74 | |
| DoLaStyle=Original, Base Model=LLaVA-1.52025.08 | 69.3 | 67.8 | 73.6 | 70.6 | |
| DecoStyle=Average, Base Model=InstructBLIP2025.08 | 68.57 | 63.62 | 87.5 | 73.63 | |
| DecoStyle=Original, Base Model=LLaVA-1.52025.08 | 68.4 | 61.7 | 97 | 75.5 | |
| DecoStyle=Painting, Base Model=InstructBLIP2025.08 | 68.3 | 63.2 | 87.9 | 73.5 | |
| SAVERStyle=Painting, Base Model=InstructBLIP2025.08 | 68.2 | 63.8 | 83.8 | 72.5 | |
| SAVERStyle=Game, Base Model=InstructBLIP2025.08 | 68.1 | 63.3 | 86.4 | 73.1 | |
| SAVERStyle=Graffiti, Base Model=InstructBLIP2025.08 | 68.1 | 63 | 87.3 | 73.2 | |
| SAVERStyle=Cartoon, Base Model=InstructBLIP2025.08 | 67.9 | 62.9 | 87 | 73 | |
| DoLaStyle=Cartoon, Base Model=LLaVA-1.52025.08 | 67.6 | 67.3 | 68.3 | 67.8 | |
| DecoStyle=Game, Base Model=InstructBLIP2025.08 | 67.4 | 62.4 | 87.9 | 73 | |
| DecoStyle=Cartoon, Base Model=InstructBLIP2025.08 | 66.9 | 61.8 | 88.4 | 72.8 | |
| DoLaStyle=Game, Base Model=LLaVA-1.52025.08 | 66.8 | 66.8 | 66.9 | 66.9 | |
| DoLaStyle=Average, Base Model=LLaVA-1.52025.08 | 66.52 | 65.65 | 67.2 | 63.88 | |
| DoLaStyle=Painting, Base Model=LLaVA-1.52025.08 | 66.4 | 66 | 67.8 | 66.9 | |
| DecoStyle=Sketch, Base Model=LLaVA-1.52025.08 | 66.4 | 60.7 | 93.4 | 73.6 | |
| DecoStyle=Graffiti, Base Model=InstructBLIP2025.08 | 66.3 | 61.2 | 89.2 | 72.6 | |
| DecoStyle=Painting, Base Model=LLaVA-1.52025.08 | 66.3 | 60.7 | 92.2 | 73.2 | |
| DecoStyle=Average, Base Model=LLaVA-1.52025.08 | 65.8 | 60.13 | 93.85 | 73.3 | |
| DecoStyle=Game, Base Model=LLaVA-1.52025.08 | 65.7 | 60.1 | 93.2 | 73.1 | |
| DoLaStyle=Sketch, Base Model=LLaVA-1.52025.08 | 65.1 | 61.9 | 63.5 | 47.5 | |
| DecoStyle=Cartoon, Base Model=LLaVA-1.52025.08 | 64.7 | 59.4 | 93.2 | 72.5 | |
| DoLaStyle=Graffiti, Base Model=LLaVA-1.52025.08 | 63.9 | 64.1 | 63.1 | 63.6 | |
| DecoStyle=Graffiti, Base Model=LLaVA-1.52025.08 | 63.3 | 58.2 | 94.1 | 71.9 | |
| SAVERStyle=Original, Base Model=MiniGPT-42025.08 | 60.4 | 56.8 | 86.9 | 68.7 | |
| SAVERStyle=Average, Base Model=MiniGPT-42025.08 | 55.63 | 53.35 | 92.42 | 67.58 | |
| SAVERStyle=Painting, Base Model=MiniGPT-42025.08 | 55.4 | 53.1 | 92.8 | 67.5 | |
| SAVERStyle=Sketch, Base Model=MiniGPT-42025.08 | 55.4 | 53.1 | 93.1 | 67.6 | |
| SAVERStyle=Game, Base Model=MiniGPT-42025.08 | 54.6 | 52.6 | 93.8 | 67.4 | |
| DecoStyle=Original, Base Model=MiniGPT-42025.08 | 54.5 | 52.5 | 94.6 | 67.5 | |
| SAVERStyle=Graffiti, Base Model=MiniGPT-42025.08 | 54.2 | 52.4 | 93.7 | 67.2 | |
| DolaStyle=Original, Base Model=MiniGPT-42025.08 | 54.2 | 55.2 | 45.1 | 49.6 | |
| SAVERStyle=Cartoon, Base Model=MiniGPT-42025.08 | 53.8 | 52.1 | 94.2 | 67.1 | |
| DolaStyle=Game, Base Model=MiniGPT-42025.08 | 53.6 | 60.9 | 19.9 | 30 | |
| DecoStyle=Sketch, Base Model=MiniGPT-42025.08 | 52.2 | 51.2 | 98.1 | 67.3 | |
| DecoStyle=Average, Base Model=MiniGPT-42025.08 | 52.15 | 51.18 | 97.32 | 67.05 | |
| DolaStyle=Cartoon, Base Model=MiniGPT-42025.08 | 52.1 | 57.3 | 16.6 | 25.7 | |
| DecoStyle=Painting, Base Model=MiniGPT-42025.08 | 51.8 | 51 | 97.9 | 67 | |
| DecoStyle=Graffiti, Base Model=MiniGPT-42025.08 | 51.7 | 50.9 | 97.6 | 66.9 | |
| DecoStyle=Game, Base Model=MiniGPT-42025.08 | 51.4 | 50.8 | 97.6 | 66.8 | |
| DecoStyle=Cartoon, Base Model=MiniGPT-42025.08 | 51.3 | 50.7 | 98.1 | 66.8 | |
| DolaStyle=Graffiti, Base Model=MiniGPT-42025.08 | 50.6 | 53.2 | 10.2 | 17.1 | |
| DolaStyle=Painting, Base Model=MiniGPT-42025.08 | 49.7 | 48.9 | 12.8 | 20.3 | |
| DolaStyle=Average, Base Model=MiniGPT-42025.08 | 45.72 | 54.53 | 26.92 | 26.07 | |
| DolaStyle=Sketch, Base Model=MiniGPT-42025.08 | 14.1 | 51.7 | 56.9 | 13.7 |