Object Hallucination Evaluation on POPE 28
88.9AccuracyLAF-7B
Evaluation Results
| Method | Links | |
|---|---|---|
| LAF-7BLM=Vicuna (7B), Res.=336, PT=558K, IT=665K2024.07 | 88.9 | |
| LLaVA-1.5+ (Ours)LM=Vicuna(7B), Res.=336, PT=558K, IT=665K2024.07 | 88.9 | |
| Mipha-3B+ (Ours)LM=Phi-2 (2.7B), Res.=384, PT=558K, IT=665K2024.07 | 88.7 | |
| Imp-v1LM=Phi-2 (2.7B), Res.=384, PT=558K, IT=665K2024.07 | 88 | |
| Mipha-3BLM=Phi-2 (2.7B), Res.=384, PT=558K, IT=665K2024.07 | 86.7 | |
| Bunny-3BLM=Phi-2 (2.7B), Res.=384, PT=2M, IT=695K2024.07 | 86.4 | |
| LLaVA-1.5LM=Vicuna (7B), Res.=336, PT=558K, IT=665K2024.07 | 85.9 | |
| mPLUG-Owl2LM=LLAMA (7B), Res.=448, PT=400M, IT=1.23M2024.07 | 85.8 | |
| TinyLLaVALM=Phi-2 (2.7B), Res.=384, PT=1.2M, IT=665k2024.07 | 85.7 | |
| BLIP-2LM=Vicuna (13B), Res.=224, PT=129M, IT=-2024.07 | 85.3 | |
| LLaVA-PhiLM=Phi-2 (2.7B), Res.=336, PT=558k, IT=665K2024.07 | 85 | |
| Mobile VLM-3BLM=M-LLaMA (2.7B), Res.=336, PT=558K, IT=665K2024.07 | 84.9 | |
| Mobile VLM-v2-3BLM=M-LLaMA (2.7B), Res.=336, PT=1.2M, IT=2.4M2024.07 | 84.7 | |
| Mobile VLM-1.7BLM=M-LLaMA (1.4B), Res.=336, PT=558K, IT=665K2024.07 | 84.5 | |
| Mobile VLM-v2-1.7BLM=M-LLaMA (1.4B), Res.=336, PT=1.2M, IT=2.4M2024.07 | 84.3 | |
| MC-LLaVALM=Phi-2 (2.7B), Res.=384, PT=558k, IT=665K2024.07 | 80.6 | |
| InstructBLIPLM=Vicuna (7B), Res.=224, PT=129M, IT=1.2M2024.07 | 78.9 | |
| InstructBLIPLM=Vicuna (13B), Res.=224, PT=129M, IT=1.2M2024.07 | 78.9 |