Character-level Accuracy on HellaSwag
66.87Character AccuracyMobileLLM-Flash 1.4B
Evaluation results
| Method | Links | |
|---|---|---|
| MobileLLM-Flash 1.4BParameter Count=1.4B, Evaluation Protocol=0-shot2026.03 | 66.87 | |
| Llama3.2 1BParameter Count=1B, Evaluation Protocol=0-shot2026.03 | 65.69 | |
| Gemma3 1BParameter Count=1B, Evaluation Protocol=0-shot2026.03 | 62.3 | |
| MobileLLM-Flash 650MParameter Count=650M, Evaluation Protocol=0-shot2026.03 | 54.6 | |
| Qwen3 0.6BParameter Count=0.6B, Evaluation Protocol=0-shot2026.03 | 53.8 | |
| MobileLLM-Flash 350MParameter Count=350M, Evaluation Protocol=0-shot2026.03 | 49.16 | |
| LFM2 350MParameter Count=350M, Evaluation Protocol=0-shot2026.03 | 49 | |
| Nemotron-Flash 1BParameter Count=1B, Evaluation Protocol=0-shot2026.03 | 45.8 | |
| LFM2 1.2BParameter Count=1.2B, Evaluation Protocol=0-shot2026.03 | 45.26 | |
| LFM2 700MParameter Count=700M, Evaluation Protocol=0-shot2026.03 | 45.01 | |
| Gemma3 270MParameter Count=270M, Evaluation Protocol=0-shot2026.03 | 41.38 |