Captioning Hallucination on OBJHal
56CRsRLHF
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| RLHFBase Model=LLaVA-v1.5-7B, RL Technique=RLHF2025.07 | 56 | 15.2 | |
| LLaVA-v1.5-7BModel Scale=7B2025.07 | 54 | 15.8 | |
| LLaVA-v1.5-13BModel Scale=13B2025.07 | 50 | 14.5 | |
| HALVABase Model=LLaVA-v1.5-7B, RL Technique=HALVA2025.07 | 47.3 | 14.6 | |
| RLHFBase Model=LLaVA-v1.5-13B, RL Technique=RLHF2025.07 | 46.7 | 11.6 | |
| HALVABase Model=LLaVA-v1.5-13B, RL Technique=HALVA2025.07 | 42.7 | 12.1 | |
| Qwen-VL2.5-8BModel Scale=8B2025.07 | 40.7 | 8.6 | |
| Intern-VL2.5-7BModel Scale=7B2025.07 | 36 | 9.1 | |
| CHiP-DPOBase Model=LLaVA-v1.5-13B, RL Technique=CHiP-DPO2025.07 | 30 | 6.2 | |
| GPT-4o2025.07 | 29.3 | 6.7 | |
| DPOBase Model=LLaVA-v1.5-13B, RL Technique=DPO2025.07 | 19 | 7.2 | |
| OPA-DPOBase Model=LLaVA-v1.5-13B, RL Technique=OPA-DPO2025.07 | 18.3 | 5.1 | |
| TARS (Replace)Base Model=LLaVA-v1.5-13B, Perturbation Strategy=Replace2025.07 | 14.9 | 3.4 | |
| TARS (Mask)Base Model=LLaVA-v1.5-13B, Perturbation Strategy=Mask2025.07 | 14.6 | 2.8 | |
| DPOBase Model=LLaVA-v1.5-7B, RL Technique=DPO2025.07 | 14 | 5 | |
| RLAIFBase Model=LLaVA-v1.5-7B, RL Technique=RLAIF2025.07 | 13.7 | 4.2 | |
| TARS (Replace)Base Model=LLaVA-v1.5-7B, Perturbation Strategy=Replace2025.07 | 13.4 | 3.3 | |
| OPA-DPOBase Model=LLaVA-v1.5-7B, RL Technique=OPA-DPO2025.07 | 13.3 | 4.5 | |
| TARS (Mask)Base Model=LLaVA-v1.5-7B, Perturbation Strategy=Mask2025.07 | 12 | 3.2 | |
| DeepSeek-VL2-27BModel Scale=27B2025.07 | 10 | 7 | |
| CHiP-DPOBase Model=LLaVA-v1.5-7B, RL Technique=CHiP-DPO2025.07 | 7.3 | 4.3 |