Video Understanding on MVBench, EgoSchema, VMME, LVB, VMMMU
68.92MVBench ScoreInternVL-3.5-30B-A3B-HF
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| InternVL-3.5-30B-A3B-HFk=8, mode=Default2025.11 | 68.92 | 60.49 | 58.07 | 57.64 | 45.11 | 100 | |
| MoDESBackbone=InternVL-3.5-30B-A3B-HF, Skip Experts=88%, rho=0.852025.11 | 68.65 | 60.79 | 57.63 | 54.49 | 44.33 | 97.03 | |
| InternVL-3.5-GPT-OSS-20B-A4B-Preview-HFk=4, mode=Default2025.11 | 67.65 | 58.79 | 53.93 | 54.65 | 43.79 | 100 | |
| MoDESBackbone=InternVL-3.5-GPT-OSS-20B-A4B-Preview-HF, Skip Experts=75%, rho=0.732025.11 | 66.6 | 57.95 | 53.59 | 53.68 | 43.13 | 97.89 | |
| Qwen3-VL-MoE-30B-A3B-Instructk=8, mode=Default2025.11 | 64.67 | 62.45 | 54.89 | 55.42 | 47.11 | 100 | |
| Qwen3-VL-MoE-30B-A3B-Instructk (Number of active experts)=8, Expert skipping ratio (rho)=02025.11 | 64.67 | 62.45 | 54.89 | 55.42 | 47.11 | 100 | |
| MoDESExpert skipping ratio (rho)=0.732025.11 | 64.45 | 62.53 | 54.81 | 55.57 | 51.22 | 99.11 | |
| MoDESExpert skipping ratio (rho)=0.62025.11 | 64.42 | 62.39 | 55.15 | 55.5 | 49.89 | 99.22 | |
| DiEPExpert skipping ratio (rho)=0.62025.11 | 63.15 | 59.46 | 53.41 | 55.08 | 48.76 | 96.8 | |
| MoDESBackbone=Qwen3-VL-MoE-30B-A3B-Instruct, Skip Experts=88%, rho=0.852025.11 | 62.98 | 62.04 | 55.26 | 55.5 | 46.56 | 97.33 | |
| MoDESExpert skipping ratio (rho)=0.852025.11 | 62.98 | 62.04 | 55.26 | 55.5 | 46.56 | 97.33 | |
| DiEPExpert skipping ratio (rho)=0.732025.11 | 62.78 | 57.86 | 52.38 | 54.62 | 48.16 | 95.21 | |
| MC-MoEExpert skipping ratio (rho)=0.62025.11 | 62.61 | 58.73 | 54.22 | 54.13 | 48.54 | 97.09 | |
| k = 3 (Default)k (Number of active experts)=3, Expert skipping ratio (rho)=0.62025.11 | 62.02 | 57.96 | 53.48 | 54.6 | 50.44 | 95.2 | |
| MC-MoEExpert skipping ratio (rho)=0.732025.11 | 61.65 | 57.13 | 52.64 | 54.03 | 47.49 | 95.11 | |
| NAEEExpert skipping ratio (rho)=0.62025.11 | 61.31 | 58.32 | 51.08 | 55.12 | 48.32 | 95.61 | |
| NAEEExpert skipping ratio (rho)=0.732025.11 | 60.98 | 55.24 | 48.87 | 54.87 | 47.12 | 93.25 | |
| k = 2 (Default)k (Number of active experts)=2, Expert skipping ratio (rho)=0.732025.11 | 60.7 | 53.79 | 50.67 | 54.08 | 46 | 92.03 | |
| MC-MoEBackbone=InternVL-3.5-GPT-OSS-20B-A4B-Preview-HF, Skip Experts=75%, rho=0.732025.11 | 60.06 | 50.28 | 48.37 | 46.68 | 42.89 | 89.91 | |
| MC-MoEBackbone=InternVL-3.5-30B-A3B-HF, Skip Experts=88%, rho=0.852025.11 | 58.97 | 52.31 | 49.72 | 48.31 | 40.06 | 86.2 | |
| DiEPBackbone=Qwen3-VL-MoE-30B-A3B-Instruct, Skip Experts=88%, rho=0.852025.11 | 57.21 | 53.61 | 50.78 | 46.13 | 34.79 | 85.3 | |
| DiEPExpert skipping ratio (rho)=0.852025.11 | 57.21 | 53.61 | 50.78 | 46.13 | 34.79 | 85.3 | |
| InternVL-3.5-GPT-OSS-20B-A4B-Preview-HFk=1, Skip Experts=75%, rho=0.732025.11 | 56.95 | 49.4 | 44.04 | 44.28 | 41.66 | 77.58 | |
| MC-MoEBackbone=Qwen3-VL-MoE-30B-A3B-Instruct, Skip Experts=88%, rho=0.852025.11 | 56.6 | 51.84 | 52.51 | 47.22 | 37.41 | 86.66 | |
| MC-MoEExpert skipping ratio (rho)=0.852025.11 | 56.6 | 51.84 | 52.51 | 47.22 | 37.41 | 86.66 | |
| DiEPBackbone=InternVL-3.5-30B-A3B-HF, Skip Experts=88%, rho=0.852025.11 | 56.26 | 51.48 | 48.94 | 47.26 | 38.18 | 83.26 | |
| NAEEBackbone=InternVL-3.5-30B-A3B-HF, Skip Experts=88%, rho=0.852025.11 | 54.78 | 50.25 | 48.69 | 47.42 | 37.27 | 78.88 | |
| DiEPBackbone=InternVL-3.5-GPT-OSS-20B-A4B-Preview-HF, Skip Experts=75%, rho=0.732025.11 | 54.18 | 49.83 | 49.42 | 47.91 | 42.31 | 90.07 | |
| NAEEBackbone=InternVL-3.5-GPT-OSS-20B-A4B-Preview-HF, Skip Experts=75%, rho=0.732025.11 | 51.25 | 46.21 | 47.83 | 45.48 | 42.08 | 86.79 | |
| NAEEBackbone=Qwen3-VL-MoE-30B-A3B-Instruct, Skip Experts=88%, rho=0.852025.11 | 50.24 | 49.77 | 44.48 | 45.59 | 35.57 | 80.6 | |
| NAEEExpert skipping ratio (rho)=0.852025.11 | 50.24 | 49.77 | 44.48 | 45.59 | 35.57 | 80.6 | |
| Qwen3-VL-MoE-30B-A3B-Instructk=1, Skip Experts=88%, rho=0.852025.11 | 41.51 | 32.52 | 39.78 | 42.41 | 12.51 | 60.11 | |
| k = 1 (Default)k (Number of active experts)=1, Expert skipping ratio (rho)=0.852025.11 | 41.51 | 32.52 | 39.78 | 42.41 | 12.51 | 60.11 | |
| InternVL-3.5-30B-A3B-HFk=1, Skip Experts=88%, rho=0.852025.11 | 31.99 | 34.47 | 35.26 | 37.4 | 24.27 | 59.63 |