Accuracy on TriviaQA (TQA)
58.1AccuracyMobileMoE-L
Evaluation Results
| Method | Links | |
|---|---|---|
| MobileMoE-LActive Parameters=922M, Total Parameters=5.3B, Few-shot count=5-shot2026.05 | 58.1 | |
| MobileMoE-LMem (GB)=2.75, INT4 QAT=true, 5-shot=true2026.05 | 52.4 | |
| MobileMoE-MActive Parameters=528M, Total Parameters=2.8B, Few-shot count=5-shot2026.05 | 49 | |
| MobileMoE-MMem (GB)=1.48, INT4 QAT=true, 5-shot=true2026.05 | 42.1 | |
| MobileLLM-ProMem (GB)=0.55, INT4 QAT=true, 5-shot=true2026.05 | 39.9 | |
| MobileMoE-SActive Parameters=272M, Total Parameters=1.3B, Few-shot count=5-shot2026.05 | 33.2 | |
| MobileMoE-SMem (GB)=0.68, INT4 QAT=true, 5-shot=true2026.05 | 25 |