List your company
ResearchFormerly WizWand

Expert Routing Consistency Analysis on 11 domains

78.16SRPLLaMA-MoE-v2
16.914432.814748.71564.6153May 21, 2025
Updated 8mo ago

Evaluation results

MethodLinks
LLaMA-MoE-v2MoE=all, A:T=1:4, S:A=02025.0578.16
Yuan2.0MoE=all, A:T=1:16, S:A=02025.0563.48
PowerMoEMoE=all, A:T=1:5, S:A=02025.0555.17
Qwen3MoE=all, A:T=1:16, S:A=02025.0554.14
Phi-3.5-MoEMoE=all, A:T=1:8, S:A=02025.0551.98
OLMoEMoE=all, A:T=1:8, S:A=02025.0550.91
GRIN-MoEMoE=all, A:T=1:8, S:A=02025.0550.39
Mixtral-8x7BMoE=all, A:T=1:4, S:A=02025.0549.36
MiniCPM-MoEMoE=all, A:T=1:4, S:A=02025.0548.85
JetMoEMoE=all, A:T=1:4, S:A=02025.0547.45
LLaMA-MoE-v1MoE=all, A:T=1:4, S:A=02025.0545.29
XVERSE-MoEMoE=all, A:T=3:32, S:A=1:32025.0538.58
Jamba-MiniMoE=every 2, A:T=1:8, S:A=02025.0538.08
DeepSeek-V2-LiteMoE=after 1st, A:T=3:32, S:A=1:32025.0537.92
DeepSeekMoEMoE=after 1st, A:T=3:32, S:A=1:32025.0536.94
Qwen2MoE=all, A:T=1:8, S:A=1:12025.0536.74
NLLB-MoE (decoder)MoE=every 4, A:T=1:64, S:A=02025.0531.35
Qwen1.5-MoEMoE=all, A:T=1:15, S:A=1:12025.0530.71
OpenMoEMoE=every 6, A:T=1:16, S:A=1:22025.0528.77
NLLB-MoE (encoder)MoE=every 4, A:T=1:64, S:A=02025.0525.24
SwitchTF (encoder)MoE=every 2, A:T=1:128, S:A=02025.0519.33
SwitchTF (decoder)MoE=every 2, A:T=1:128, S:A=02025.0519.27