Character-level Accuracy Reasoning on WinoGrande
64.01Character-level AccuracyMobileLLM-Flash 1.4B
Evaluation results
| Method | Links | |
|---|---|---|
| MobileLLM-Flash 1.4BParameter Count=1.4B, Evaluation Protocol=0-shot2026.03 | 64.01 | |
| Llama3.2 1BParameter Count=1B, Evaluation Protocol=0-shot2026.03 | 61.09 | |
| Nemotron-Flash 1BParameter Count=1B, Evaluation Protocol=0-shot2026.03 | 59.67 | |
| MobileLLM-Flash 650MParameter Count=650M, Evaluation Protocol=0-shot2026.03 | 59.35 | |
| Qwen3 0.6BParameter Count=0.6B, Evaluation Protocol=0-shot2026.03 | 58.88 | |
| LFM2 1.2BParameter Count=1.2B, Evaluation Protocol=0-shot2026.03 | 58.8 | |
| LFM2 700MParameter Count=700M, Evaluation Protocol=0-shot2026.03 | 58.4 | |
| Gemma3 1BParameter Count=1B, Evaluation Protocol=0-shot2026.03 | 58.2 | |
| MobileLLM-Flash 350MParameter Count=350M, Evaluation Protocol=0-shot2026.03 | 56.09 | |
| LFM2 350MParameter Count=350M, Evaluation Protocol=0-shot2026.03 | 55.96 | |
| Gemma3 270MParameter Count=270M, Evaluation Protocol=0-shot2026.03 | 53.59 |