List your company
ResearchFormerly WizWand

Multimodal Evaluation on SEED-Bench 2 Plus

71.67AccuracyFull Prec
-2.27416.92336.1255.317Aug 5, 2025
Updated 7mo ago

Evaluation results

MethodLinks
Full PrecModel=Qwen2.5-VL-32B-Instruct, Bit-width=Full Precision2025.0871.67
Full PrecModel=Qwen2.5-VL-7B-Instruct, Bit-width=Full Precision2025.0870.62
Full PrecModel=Qwen2-VL-7B-Instruct, Bit-width=Full Precision2025.0869.26
GPTAQModel=Qwen2.5-VL-32B-Instruct, Bit-width=3-bit2025.0867.89
VLMQModel=Qwen2.5-VL-7B-Instruct, Bit-width=3-bit, Importance Factor Configuration=Default (ℓ1-norm)2025.0867.32
GPTQModel=Qwen2.5-VL-7B-Instruct, Bit-width=3-bit2025.0866.58
GPTAQModel=Qwen2.5-VL-7B-Instruct, Bit-width=3-bit2025.0866.4
VLMQModel=Qwen2.5-VL-32B-Instruct, Bit-width=3-bit, Importance Factor Configuration=Default (ℓ1-norm)2025.0865.96
VLMQModel=Qwen2-VL-7B-Instruct, Bit-width=3-bit, Importance Factor Configuration=Default (ℓ1-norm)2025.0865.52
GPTQModel=Qwen2.5-VL-32B-Instruct, Bit-width=3-bit2025.0864.87
Full PrecModel=LLaVA-OneVision-7B, Bit-width=Full Precision2025.0864.82
GPTAQModel=Qwen2-VL-7B-Instruct, Bit-width=3-bit2025.0864.21
GPTQModel=Qwen2-VL-7B-Instruct, Bit-width=3-bit2025.0863.02
GPTAQModel=LLaVA-OneVision-7B, Bit-width=3-bit2025.0861.84
Full PrecModel=Qwen2-VL-2B-Instruct, Bit-width=Full Precision2025.0861.79
VLMQModel=LLaVA-OneVision-7B, Bit-width=3-bit, Importance Factor Configuration=token-level ℓ2-norm2025.0861.05
VLMQModel=LLaVA-OneVision-7B, Bit-width=3-bit, Importance Factor Configuration=Default (ℓ1-norm)2025.0860.91
GPTQModel=LLaVA-OneVision-7B, Bit-width=3-bit2025.0860.65
Full PrecModel=LLaVA-OneVision-0.5B, Bit-width=Full Precision2025.0853.05
VLMQModel=Qwen2-VL-2B-Instruct, Bit-width=3-bit, Importance Factor Configuration=Default (ℓ1-norm)2025.0852.92
GPTAQModel=Qwen2-VL-2B-Instruct, Bit-width=3-bit2025.0852.17
GPTQModel=Qwen2-VL-2B-Instruct, Bit-width=3-bit2025.0850.37
AWQModel=Qwen2-VL-7B-Instruct, Bit-width=3-bit2025.0844.88
MBQModel=Qwen2-VL-7B-Instruct, Bit-width=3-bit2025.0840.1
AWQModel=Qwen2-VL-2B-Instruct, Bit-width=3-bit2025.0818.53
MBQModel=Qwen2-VL-2B-Instruct, Bit-width=3-bit2025.088.12
VLMQModel=LLaVA-OneVision-0.5B, Bit-width=3-bit, Importance Factor Configuration=‡ (unspecified variant)2025.083.03
GPTAQModel=LLaVA-OneVision-0.5B, Bit-width=3-bit2025.081.23
GPTQModel=LLaVA-OneVision-0.5B, Bit-width=3-bit2025.080.57