Multimodal Understanding on MMMU zero-shot
73.67Zero-shot AccuracyBF16
Evaluation Results
| Method | Links | |
|---|---|---|
| BF16Model=Qwen3-VL-30B-A3B-Instruct, Bit-width=BF16, Evaluation Protocol=Zero-shot2026.02 | 73.67 | |
| GPTQModel=Qwen3-VL-30B-A3B-Instruct, Bit-width=W4, Evaluation Protocol=Zero-shot2026.02 | 72.67 | |
| VEQ-MAModel=Qwen3-VL-30B-A3B-Instruct, Bit-width=W4, Evaluation Protocol=Zero-shot2026.02 | 71.56 | |
| MBQModel=Qwen3-VL-30B-A3B-Instruct, Bit-width=W4, Evaluation Protocol=Zero-shot2026.02 | 69.67 | |
| VEQ-MEModel=Qwen3-VL-30B-A3B-Instruct, Bit-width=W4, Evaluation Protocol=Zero-shot2026.02 | 68.78 | |
| VEQ-MAModel=Qwen3-VL-30B-A3B-Instruct, Bit-width=W3, Evaluation Protocol=Zero-shot2026.02 | 65.89 | |
| AWQModel=Qwen3-VL-30B-A3B-Instruct, Bit-width=W4, Evaluation Protocol=Zero-shot2026.02 | 65.2 | |
| GPTQModel=Qwen3-VL-30B-A3B-Instruct, Bit-width=W3, Evaluation Protocol=Zero-shot2026.02 | 64.89 | |
| RTNModel=Qwen3-VL-30B-A3B-Instruct, Bit-width=W4, Evaluation Protocol=Zero-shot2026.02 | 63.11 | |
| VEQ-MEModel=Qwen3-VL-30B-A3B-Instruct, Bit-width=W3, Evaluation Protocol=Zero-shot2026.02 | 60.56 | |
| AWQModel=Qwen3-VL-30B-A3B-Instruct, Bit-width=W3, Evaluation Protocol=Zero-shot2026.02 | 58.89 | |
| RTNModel=Qwen3-VL-30B-A3B-Instruct, Bit-width=W3, Evaluation Protocol=Zero-shot2026.02 | 57.33 | |
| BF16Model=Kimi-VL-Instruct, Bit-width=BF16, Evaluation Protocol=Zero-shot2026.02 | 51.11 | |
| MBQModel=Qwen3-VL-30B-A3B-Instruct, Bit-width=W3, Evaluation Protocol=Zero-shot2026.02 | 50.56 | |
| VEQ-MAModel=Kimi-VL-Instruct, Bit-width=W4, Evaluation Protocol=Zero-shot2026.02 | 50.3 | |
| GPTQModel=Kimi-VL-Instruct, Bit-width=W4, Evaluation Protocol=Zero-shot2026.02 | 50 | |
| VEQ-MEModel=Kimi-VL-Instruct, Bit-width=W4, Evaluation Protocol=Zero-shot2026.02 | 49.22 | |
| AWQModel=Kimi-VL-Instruct, Bit-width=W4, Evaluation Protocol=Zero-shot2026.02 | 49 | |
| MBQModel=Kimi-VL-Instruct, Bit-width=W4, Evaluation Protocol=Zero-shot2026.02 | 48.89 | |
| RTNModel=Kimi-VL-Instruct, Bit-width=W4, Evaluation Protocol=Zero-shot2026.02 | 48.44 | |
| VEQ-MEModel=Kimi-VL-Instruct, Bit-width=W3, Evaluation Protocol=Zero-shot2026.02 | 44.56 | |
| VEQ-MAModel=Kimi-VL-Instruct, Bit-width=W3, Evaluation Protocol=Zero-shot2026.02 | 42.56 | |
| AWQModel=Kimi-VL-Instruct, Bit-width=W3, Evaluation Protocol=Zero-shot2026.02 | 41.78 | |
| GPTQModel=Kimi-VL-Instruct, Bit-width=W3, Evaluation Protocol=Zero-shot2026.02 | 40.33 | |
| MBQModel=Kimi-VL-Instruct, Bit-width=W3, Evaluation Protocol=Zero-shot2026.02 | 39.76 | |
| RTNModel=Kimi-VL-Instruct, Bit-width=W3, Evaluation Protocol=Zero-shot2026.02 | 37 |