List your company
ResearchFormerly WizWand

Image-Language Understanding on SQA (EM)

71.6EMOriginal
6.672823.528940.38557.2411Mar 7, 2025
Updated 8mo ago

Evaluation results

MethodLinks
OriginalModel=LLaVA1.5-13B, Bit=162025.0371.6
CASPQuIP#Model=LLaVA1.5-13B, Bit=22025.0371.2
OriginalModel=LLaVA-Next-7B, Bit=162025.0370.1
QuIP#Model=LLaVA1.5-13B, Bit=22025.0368.3
OriginalModel=LLaVA1.5-7B, Bit=162025.0367.9
CASPAQLMModel=LLaVA1.5-13B, Bit=22025.0367.9
CASPQuIP#Model=LLaVA1.5-7B, Bit=22025.0361.6
CASPQuIP#Model=LLaVA-Next-7B, Bit=22025.0361.1
QuIP#Model=LLaVA-Next-7B, Bit=22025.0360.6
QuIP#Model=LLaVA1.5-7B, Bit=22025.0360.3
CASPGPTQModel=LLaVA1.5-13B, Bit=2.22025.0359.7
AQLMModel=LLaVA1.5-13B, Bit=22025.0357.7
CASPAQLMModel=LLaVA-Next-7B, Bit=22025.0353.5
CASPAQLMModel=LLaVA1.5-7B, Bit=22025.0350.8
CASPGPTQModel=LLaVA1.5-7B, Bit=2.22025.0343.9
CASPGPTQModel=LLaVA-Next-7B, Bit=2.22025.0337.5
AQLMModel=LLaVA1.5-7B, Bit=22025.0336.7
AQLMModel=LLaVA-Next-7B, Bit=22025.0332.7
GPTQModel=LLaVA1.5-13B, Bit=2.22025.0324.6
GPTQModel=LLaVA-Next-7B, Bit=2.22025.039.42
GPTQModel=LLaVA1.5-7B, Bit=2.22025.039.17