Multimodal Evaluation on SEED-Bench 2 Plus
71.67AccuracyFull Prec
Evaluation Results
| Method | Links | |
|---|---|---|
| Full PrecModel=Qwen2.5-VL-32B-Instruct, Bit-width=Full Precision2025.08 | 71.67 | |
| Full PrecModel=Qwen2.5-VL-7B-Instruct, Bit-width=Full Precision2025.08 | 70.62 | |
| Full PrecModel=Qwen2-VL-7B-Instruct, Bit-width=Full Precision2025.08 | 69.26 | |
| GPTAQModel=Qwen2.5-VL-32B-Instruct, Bit-width=3-bit2025.08 | 67.89 | |
| VLMQModel=Qwen2.5-VL-7B-Instruct, Bit-width=3-bit, Importance Factor Configuration=Default (ℓ1-norm)2025.08 | 67.32 | |
| GPTQModel=Qwen2.5-VL-7B-Instruct, Bit-width=3-bit2025.08 | 66.58 | |
| GPTAQModel=Qwen2.5-VL-7B-Instruct, Bit-width=3-bit2025.08 | 66.4 | |
| VLMQModel=Qwen2.5-VL-32B-Instruct, Bit-width=3-bit, Importance Factor Configuration=Default (ℓ1-norm)2025.08 | 65.96 | |
| VLMQModel=Qwen2-VL-7B-Instruct, Bit-width=3-bit, Importance Factor Configuration=Default (ℓ1-norm)2025.08 | 65.52 | |
| GPTQModel=Qwen2.5-VL-32B-Instruct, Bit-width=3-bit2025.08 | 64.87 | |
| Full PrecModel=LLaVA-OneVision-7B, Bit-width=Full Precision2025.08 | 64.82 | |
| GPTAQModel=Qwen2-VL-7B-Instruct, Bit-width=3-bit2025.08 | 64.21 | |
| GPTQModel=Qwen2-VL-7B-Instruct, Bit-width=3-bit2025.08 | 63.02 | |
| GPTAQModel=LLaVA-OneVision-7B, Bit-width=3-bit2025.08 | 61.84 | |
| Full PrecModel=Qwen2-VL-2B-Instruct, Bit-width=Full Precision2025.08 | 61.79 | |
| VLMQModel=LLaVA-OneVision-7B, Bit-width=3-bit, Importance Factor Configuration=token-level ℓ2-norm2025.08 | 61.05 | |
| VLMQModel=LLaVA-OneVision-7B, Bit-width=3-bit, Importance Factor Configuration=Default (ℓ1-norm)2025.08 | 60.91 | |
| GPTQModel=LLaVA-OneVision-7B, Bit-width=3-bit2025.08 | 60.65 | |
| Full PrecModel=LLaVA-OneVision-0.5B, Bit-width=Full Precision2025.08 | 53.05 | |
| VLMQModel=Qwen2-VL-2B-Instruct, Bit-width=3-bit, Importance Factor Configuration=Default (ℓ1-norm)2025.08 | 52.92 | |
| GPTAQModel=Qwen2-VL-2B-Instruct, Bit-width=3-bit2025.08 | 52.17 | |
| GPTQModel=Qwen2-VL-2B-Instruct, Bit-width=3-bit2025.08 | 50.37 | |
| AWQModel=Qwen2-VL-7B-Instruct, Bit-width=3-bit2025.08 | 44.88 | |
| MBQModel=Qwen2-VL-7B-Instruct, Bit-width=3-bit2025.08 | 40.1 | |
| AWQModel=Qwen2-VL-2B-Instruct, Bit-width=3-bit2025.08 | 18.53 | |
| MBQModel=Qwen2-VL-2B-Instruct, Bit-width=3-bit2025.08 | 8.12 | |
| VLMQModel=LLaVA-OneVision-0.5B, Bit-width=3-bit, Importance Factor Configuration=‡ (unspecified variant)2025.08 | 3.03 | |
| GPTAQModel=LLaVA-OneVision-0.5B, Bit-width=3-bit2025.08 | 1.23 | |
| GPTQModel=LLaVA-OneVision-0.5B, Bit-width=3-bit2025.08 | 0.57 |