Knowledge on Natural Questions
26.7AccuracyMobileMoE-L
Evaluation results
| Method | Links | |
|---|---|---|
| MobileMoE-LActive Parameters=922M, Total Parameters=5.3B, Few-shot count=5-shot2026.05 | 26.7 | |
| MobileMoE-MActive Parameters=528M, Total Parameters=2.8B, Few-shot count=5-shot2026.05 | 20.9 | |
| MobileMoE-LMem (GB)=2.75, INT4 QAT=true, 5-shot=true2026.05 | 19.4 | |
| MobileLLM-ProMem (GB)=0.55, INT4 QAT=true, 5-shot=true2026.05 | 13.9 | |
| MobileMoE-SActive Parameters=272M, Total Parameters=1.3B, Few-shot count=5-shot2026.05 | 12.6 | |
| MobileMoE-SMem (GB)=0.68, INT4 QAT=true, 5-shot=true2026.05 | 8.6 | |
| MobileMoE-MMem (GB)=1.48, INT4 QAT=true, 5-shot=true2026.05 | 5 |