List your company
ResearchFormerly WizWand

Vision Understanding on LLaVA-Wild

74.2LLaVA-Wild AccuracyLLaVA-FastV (k=3, r=0.75)
65.46467.7327072.268Dec 1, 2024
Updated 8mo ago

Evaluation results

MethodLinks
LLaVA-FastV (k=3, r=0.75)LLM=Vicuna-13B, Res.=336, Token=144 (-75%), TFLOPS=6.0 (-69%)2024.1274.2
Dynamic-LLaVA-13BILLM=Vicuna-13B, Res.=336, Token=115 (-80%), TFLOPS=4.7+0.01 (-76%)2024.1273.4
LLaVA-1.5-13BLLM=Vicuna-13B, Res.=336, Token=576, TFLOPS=19.62024.1272.5
Dynamic-LLaVA-13BITLLM=Vicuna-13B, Res.=336, Token=115 (-80%), TFLOPS=4.7+0.01 (-76%)2024.1270.1
Dynamic-LLaVA-7BITLLM=Vicuna-7B, Res.=336, Token=115 (-80%), TFLOPS=2.5+0.01 (-75%)2024.1268.7
Dynamic-LLaVA-7BILLM=Vicuna-7B, Res.=336, Token=115 (-80%), TFLOPS=2.5+0.01 (-75%)2024.1267.3
LLaVA-FastV (k=3, r=0.75)LLM=Vicuna-7B, Res.=336, Token=144 (-75%), TFLOPS=3.2 (-68%)2024.1266.7
LLaVA-1.5-7BLLM=Vicuna-7B, Res.=336, Token=576, TFLOPS=10.12024.1265.8