Diagram Understanding on AI2D zero-shot
83.65Zero-shot AccuracyBF16
Evaluation results
| Method | Links | |
|---|---|---|
| BF16Model=Kimi-VL-Instruct, Bit-width=BF16, Evaluation Protocol=Zero-shot2026.02 | 83.65 | |
| VEQ-MAModel=Qwen3-VL-30B-A3B-Instruct, Bit-width=W4, Evaluation Protocol=Zero-shot2026.02 | 82.95 | |
| VEQ-MAModel=Kimi-VL-Instruct, Bit-width=W4, Evaluation Protocol=Zero-shot2026.02 | 82.55 | |
| VEQ-MAModel=Qwen3-VL-30B-A3B-Instruct, Bit-width=W3, Evaluation Protocol=Zero-shot2026.02 | 79.15 | |
| VEQ-MAModel=Kimi-VL-Instruct, Bit-width=W3, Evaluation Protocol=Zero-shot2026.02 | 75.65 |