Multimodal Evaluation on MME-R
52.48ScoreBF16
Evaluation Results
| Method | Links | |
|---|---|---|
| BF16Model=Qwen3-VL-30B-A3B-Instruct, Avg-Bit=BF162026.06 | 52.48 | |
| MODEModel=Qwen3-VL-30B-A3B-Instruct, Avg-Bit=W32026.06 | 50.77 | |
| MC-MoEModel=Qwen3-VL-30B-A3B-Instruct, Avg-Bit=W32026.06 | 47.88 | |
| VEQ-MEModel=Qwen3-VL-30B-A3B-Instruct, Avg-Bit=W32026.06 | 47.41 | |
| Speed-QModel=Qwen3-VL-30B-A3B-Instruct, Avg-Bit=W32026.06 | 46.46 | |
| MoEQuantModel=Qwen3-VL-30B-A3B-Instruct, Avg-Bit=W32026.06 | 46.03 | |
| MBQModel=Qwen3-VL-30B-A3B-Instruct, Avg-Bit=W32026.06 | 45.71 | |
| GPTQModel=Qwen3-VL-30B-A3B-Instruct, Avg-Bit=W32026.06 | 45.29 | |
| MODEModel=Qwen3-VL-30B-A3B-Instruct, Avg-Bit=W22026.06 | 44.85 | |
| BF16Model=Kimi-VL-A3B-Instruct, Avg-Bit=BF162026.06 | 44.45 | |
| MODEModel=Kimi-VL-A3B-Instruct, Avg-Bit=W32026.06 | 41.59 | |
| MC-MoEModel=Qwen3-VL-30B-A3B-Instruct, Avg-Bit=W22026.06 | 40.48 | |
| MC-MoEModel=Kimi-VL-A3B-Instruct, Avg-Bit=W32026.06 | 40.02 | |
| VEQ-MEModel=Kimi-VL-A3B-Instruct, Avg-Bit=W32026.06 | 39.97 | |
| MoEQuantModel=Kimi-VL-A3B-Instruct, Avg-Bit=W32026.06 | 39.45 | |
| Speed-QModel=Kimi-VL-A3B-Instruct, Avg-Bit=W32026.06 | 39.21 | |
| VEQ-MEModel=Qwen3-VL-30B-A3B-Instruct, Avg-Bit=W22026.06 | 38.97 | |
| MODEModel=Kimi-VL-A3B-Instruct, Avg-Bit=W22026.06 | 38.71 | |
| MBQModel=Kimi-VL-A3B-Instruct, Avg-Bit=W32026.06 | 38.52 | |
| MoEQuantModel=Qwen3-VL-30B-A3B-Instruct, Avg-Bit=W22026.06 | 38.31 | |
| GPTQModel=Kimi-VL-A3B-Instruct, Avg-Bit=W32026.06 | 37.27 | |
| MC-MoEModel=Kimi-VL-A3B-Instruct, Avg-Bit=W22026.06 | 36.01 | |
| VEQ-MEModel=Kimi-VL-A3B-Instruct, Avg-Bit=W22026.06 | 35.52 | |
| Speed-QModel=Qwen3-VL-30B-A3B-Instruct, Avg-Bit=W22026.06 | 33.98 | |
| MoEQuantModel=Kimi-VL-A3B-Instruct, Avg-Bit=W22026.06 | 33.12 | |
| Speed-QModel=Kimi-VL-A3B-Instruct, Avg-Bit=W22026.06 | 31.98 | |
| MBQModel=Qwen3-VL-30B-A3B-Instruct, Avg-Bit=W22026.06 | 31.63 | |
| MBQModel=Kimi-VL-A3B-Instruct, Avg-Bit=W22026.06 | 29.57 | |
| GPTQModel=Kimi-VL-A3B-Instruct, Avg-Bit=W22026.06 | 24.23 | |
| GPTQModel=Qwen3-VL-30B-A3B-Instruct, Avg-Bit=W22026.06 | 12.94 |