Image Understanding on MMBench English
86.82AccuracyVanilla MoE
Evaluation results
| Method | Links | |
|---|---|---|
| Vanilla MoEBackbone=QWEN3-VL-30B-A3B-INSTRUCT2026.04 | 86.82 | |
| MACS (Ours)Backbone=QWEN3-VL-30B-A3B-INSTRUCT2026.04 | 86.67 | |
| MACS (w/o Expanded)Backbone=QWEN3-VL-30B-A3B-INSTRUCT2026.04 | 86.12 | |
| Vanilla MoEBackbone=INTERNVL3.5-30B-A3B2026.04 | 84.68 | |
| MACS (Ours)Backbone=INTERNVL3.5-30B-A3B2026.04 | 84.49 | |
| MACS (w/o Expanded)Backbone=INTERNVL3.5-30B-A3B2026.04 | 84.02 | |
| Vanilla MoEBackbone=KIMI-VL-A3B-INSTRUCT2026.04 | 83.11 | |
| CAI-MoE (Expanded)Backbone=QWEN3-VL-30B-A3B-INSTRUCT2026.04 | 83.05 | |
| MACS (Ours)Backbone=KIMI-VL-A3B-INSTRUCT2026.04 | 83.02 | |
| MACS (w/o Expanded)Backbone=KIMI-VL-A3B-INSTRUCT2026.04 | 82.76 | |
| CAI-MoE (Token Drop)Backbone=QWEN3-VL-30B-A3B-INSTRUCT2026.04 | 81.34 | |
| CAI-MoE (Expanded)Backbone=INTERNVL3.5-30B-A3B2026.04 | 80.76 | |
| CAI-MoE (Expanded)Backbone=KIMI-VL-A3B-INSTRUCT2026.04 | 79.62 | |
| CAI-MoE (Token Drop)Backbone=INTERNVL3.5-30B-A3B2026.04 | 78.23 | |
| CAI-MoE (Token Drop)Backbone=KIMI-VL-A3B-INSTRUCT2026.04 | 77.45 |