Hallucination Assessment on CHAIR
52.8CSRegular
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| RegularBackbone=LLaVA-1.5-7B, Max new tokens=5122026.05 | 52.8 | 15.9 | 77.3 | 93.4 | |
| VCDBackbone=LLaVA-1.5-7B, Max new tokens=5122026.05 | 51.6 | 14.9 | 77.2 | 101.9 | |
| RegularBackbone=Qwen-VL-Chat, Max new tokens=5122026.05 | 50.2 | 14.2 | 76.4 | 92.1 | |
| VCDBackbone=Qwen-VL-Chat, Max new tokens=5122026.05 | 47.3 | 13.7 | 75.3 | 98.1 | |
| OPERABackbone=LLaVA-1.5-7B, Max new tokens=5122026.05 | 44.6 | 12.8 | 78.5 | 95.3 | |
| OPERABackbone=Qwen-VL-Chat, Max new tokens=5122026.05 | 42.3 | 12.3 | 79.4 | 97.5 | |
| PAIBackbone=LLaVA-1.5-7B, Max new tokens=5122026.05 | 39.1 | 12.4 | 76.9 | 94.4 | |
| VTIBackbone=LLaVA-1.5-7B, Max new tokens=5122026.05 | 37.6 | 12.9 | 79.3 | 93.8 | |
| PAIBackbone=Qwen-VL-Chat, Max new tokens=5122026.05 | 37.2 | 11.9 | 82.3 | 96.3 | |
| VTIBackbone=Qwen-VL-Chat, Max new tokens=5122026.05 | 35.6 | 11.5 | 81.2 | 95.3 | |
| CRGBackbone=LLaVA-1.5-7B, Max new tokens=5122026.05 | 34.2 | 11.2 | 77.8 | 98.1 | |
| CRGBackbone=Qwen-VL-Chat, Max new tokens=5122026.05 | 32.4 | 10.4 | 81.6 | 96.6 |