Visual Question Answering for object probing on POPE Aggregated random, popular, and adversarial
86.53Accuracy (POPE Aggregated)RUDDER-Beta
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| RUDDER-BetaDecoding Strategy=Greedy, LVLM=LLaVA-1.52025.11 | 86.53 | 86.03 | |
| RUDDER-BetaDecoding Strategy=Beam Search, LVLM=LLaVA-1.52025.11 | 86.51 | 86.19 | |
| VISTADecoding Strategy=Greedy, LVLM=InstructBLIP2025.11 | 86.25 | 85.06 | |
| VISTADecoding Strategy=Greedy, LVLM=LLaVA-1.52025.11 | 86.21 | 85.42 | |
| VISTADecoding Strategy=Nucleus Sampling, LVLM=InstructBLIP2025.11 | 86.12 | 85.26 | |
| VISTADecoding Strategy=Beam Search, LVLM=LLaVA-1.52025.11 | 86.1 | 85.35 | |
| RUDDER-AddDecoding Strategy=Greedy, LVLM=InstructBLIP2025.11 | 86.05 | 85.05 | |
| RUDDER-BetaDecoding Strategy=Greedy, LVLM=InstructBLIP2025.11 | 86.02 | 84.93 | |
| PAIDecoding Strategy=Greedy, LVLM=LLaVA-1.52025.11 | 85.98 | 85.31 | |
| RUDDER-AddDecoding Strategy=Beam Search, LVLM=LLaVA-1.52025.11 | 85.98 | 85.02 | |
| RUDDER-AddDecoding Strategy=Nucleus Sampling, LVLM=InstructBLIP2025.11 | 85.95 | 84.95 | |
| RUDDER-AddDecoding Strategy=Greedy, LVLM=LLaVA-1.52025.11 | 85.92 | 84.98 | |
| VCDDecoding Strategy=Greedy, LVLM=InstructBLIP2025.11 | 85.79 | 84.89 | |
| RUDDER-BetaDecoding Strategy=Nucleus Sampling, LVLM=InstructBLIP2025.11 | 85.79 | 84.74 | |
| VanillaDecoding Strategy=Greedy, LVLM=InstructBLIP2025.11 | 85.74 | 84.75 | |
| RUDDER-AddDecoding Strategy=Beam Search, LVLM=InstructBLIP2025.11 | 85.71 | 84.75 | |
| VISTADecoding Strategy=Beam Search, LVLM=InstructBLIP2025.11 | 85.64 | 84.61 | |
| VCDDecoding Strategy=Nucleus Sampling, LVLM=InstructBLIP2025.11 | 85.61 | 84.65 | |
| VCDDecoding Strategy=Beam Search, LVLM=LLaVA-1.52025.11 | 85.6 | 85.06 | |
| PAIDecoding Strategy=Beam Search, LVLM=LLaVA-1.52025.11 | 85.58 | 85.01 | |
| RUDDER-BetaDecoding Strategy=Beam Search, LVLM=InstructBLIP2025.11 | 85.54 | 84.4 | |
| DoLaDecoding Strategy=Greedy, LVLM=LLaVA-1.52025.11 | 85.51 | 84.96 | |
| VanillaDecoding Strategy=Nucleus Sampling, LVLM=InstructBLIP2025.11 | 85.5 | 84.52 | |
| VCDDecoding Strategy=Greedy, LVLM=LLaVA-1.52025.11 | 85.46 | 84.87 | |
| VanillaDecoding Strategy=Beam Search, LVLM=LLaVA-1.52025.11 | 85.46 | 84.98 | |
| VanillaDecoding Strategy=Greedy, LVLM=LLaVA-1.52025.11 | 85.34 | 84.91 | |
| VCDDecoding Strategy=Beam Search, LVLM=InstructBLIP2025.11 | 84.95 | 84.59 | |
| VanillaDecoding Strategy=Beam Search, LVLM=InstructBLIP2025.11 | 84.73 | 84.37 | |
| RUDDER-BetaDecoding Strategy=Nucleus Sampling, LVLM=LLaVA-1.52025.11 | 84.02 | 83.57 | |
| VISTADecoding Strategy=Nucleus Sampling, LVLM=LLaVA-1.52025.11 | 83.58 | 82.21 | |
| RUDDER-AddDecoding Strategy=Nucleus Sampling, LVLM=LLaVA-1.52025.11 | 83.2 | 82.38 | |
| PAIDecoding Strategy=Nucleus Sampling, LVLM=LLaVA-1.52025.11 | 83.17 | 82.14 | |
| VanillaDecoding Strategy=Nucleus Sampling, LVLM=LLaVA-1.52025.11 | 83 | 81.08 | |
| DoLaDecoding Strategy=Nucleus Sampling, LVLM=LLaVA-1.52025.11 | 82.94 | 81.12 | |
| VCDDecoding Strategy=Nucleus Sampling, LVLM=LLaVA-1.52025.11 | 82.82 | 81.9 | |
| RUDDER-BetaDecoding Strategy=Beam Search, LVLM=Idefics22025.11 | 79.33 | 77.96 | |
| RUDDER-AddDecoding Strategy=Beam Search, LVLM=Idefics22025.11 | 78.91 | 77.6 | |
| RUDDER-BetaDecoding Strategy=Greedy, LVLM=Idefics22025.11 | 78.74 | 76.52 | |
| VanillaDecoding Strategy=Beam Search, LVLM=Idefics22025.11 | 78.67 | 77.55 | |
| RUDDER-AddDecoding Strategy=Greedy, LVLM=Idefics22025.11 | 78.43 | 75.91 | |
| VanillaDecoding Strategy=Greedy, LVLM=Idefics22025.11 | 78.4 | 74.86 | |
| VISTADecoding Strategy=Beam Search, LVLM=Idefics22025.11 | 78.4 | 77.31 | |
| VISTADecoding Strategy=Greedy, LVLM=Idefics22025.11 | 78.28 | 74.66 | |
| RUDDER-BetaDecoding Strategy=Nucleus Sampling, LVLM=Idefics22025.11 | 75.89 | 69.69 | |
| RUDDER-AddDecoding Strategy=Nucleus Sampling, LVLM=Idefics22025.11 | 74.95 | 67.84 | |
| VanillaDecoding Strategy=Nucleus Sampling, LVLM=Idefics22025.11 | 74.84 | 67.78 | |
| VISTADecoding Strategy=Nucleus Sampling, LVLM=Idefics22025.11 | 74.66 | 67.7 |