List your company
ResearchFormerly WizWand

Object Hallucination Evaluation on POPE 28

88.9AccuracyLAF-7B
78.581.283.986.6Jul 5, 2024
Updated 8mo ago

Evaluation results

MethodLinks
LAF-7BLM=Vicuna (7B), Res.=336, PT=558K, IT=665K2024.0788.9
LLaVA-1.5+ (Ours)LM=Vicuna(7B), Res.=336, PT=558K, IT=665K2024.0788.9
Mipha-3B+ (Ours)LM=Phi-2 (2.7B), Res.=384, PT=558K, IT=665K2024.0788.7
Imp-v1LM=Phi-2 (2.7B), Res.=384, PT=558K, IT=665K2024.0788
Mipha-3BLM=Phi-2 (2.7B), Res.=384, PT=558K, IT=665K2024.0786.7
Bunny-3BLM=Phi-2 (2.7B), Res.=384, PT=2M, IT=695K2024.0786.4
LLaVA-1.5LM=Vicuna (7B), Res.=336, PT=558K, IT=665K2024.0785.9
mPLUG-Owl2LM=LLAMA (7B), Res.=448, PT=400M, IT=1.23M2024.0785.8
TinyLLaVALM=Phi-2 (2.7B), Res.=384, PT=1.2M, IT=665k2024.0785.7
BLIP-2LM=Vicuna (13B), Res.=224, PT=129M, IT=-2024.0785.3
LLaVA-PhiLM=Phi-2 (2.7B), Res.=336, PT=558k, IT=665K2024.0785
Mobile VLM-3BLM=M-LLaMA (2.7B), Res.=336, PT=558K, IT=665K2024.0784.9
Mobile VLM-v2-3BLM=M-LLaMA (2.7B), Res.=336, PT=1.2M, IT=2.4M2024.0784.7
Mobile VLM-1.7BLM=M-LLaMA (1.4B), Res.=336, PT=558K, IT=665K2024.0784.5
Mobile VLM-v2-1.7BLM=M-LLaMA (1.4B), Res.=336, PT=1.2M, IT=2.4M2024.0784.3
MC-LLaVALM=Phi-2 (2.7B), Res.=384, PT=558k, IT=665K2024.0780.6
InstructBLIPLM=Vicuna (7B), Res.=224, PT=129M, IT=1.2M2024.0778.9
InstructBLIPLM=Vicuna (13B), Res.=224, PT=129M, IT=1.2M2024.0778.9