Reasoning on BBH-LB
38.3Accuracy (BBH-LB)MobileMoE-L
Evaluation Results
| Method | Links | |
|---|---|---|
| MobileMoE-LMem (GB)=2.75, INT4 QAT=true, 3-shot=true2026.05 | 38.3 | |
| MobileMoE-MMem (GB)=1.48, INT4 QAT=true, 3-shot=true2026.05 | 36.2 | |
| MobileLLM-ProMem (GB)=0.55, INT4 QAT=true, 3-shot=true2026.05 | 31.4 | |
| MobileMoE-SMem (GB)=0.68, INT4 QAT=true, 3-shot=true2026.05 | 31.4 |