List your company
ResearchFormerly WizWand

Reasoning on BBH-LB

38.3Accuracy (BBH-LB)MobileMoE-L
31.12432.98734.8536.713May 26, 2026
Updated 5mo ago

Evaluation results

MethodLinks
MobileMoE-LMem (GB)=2.75, INT4 QAT=true, 3-shot=true2026.0538.3
MobileMoE-MMem (GB)=1.48, INT4 QAT=true, 3-shot=true2026.0536.2
MobileLLM-ProMem (GB)=0.55, INT4 QAT=true, 3-shot=true2026.0531.4
MobileMoE-SMem (GB)=0.68, INT4 QAT=true, 3-shot=true2026.0531.4