Reading Comprehension on BoolQ (Character-level Accuracy)
71.38Character-level AccuracyLFM2 700M
Evaluation results
| Method | Links | |
|---|---|---|
| LFM2 700MParameter Count=700M, Evaluation Protocol=0-shot2026.03 | 71.38 | |
| MobileLLM-Flash 1.4BParameter Count=1.4B, Evaluation Protocol=0-shot2026.03 | 71.07 | |
| Qwen3 0.6BParameter Count=0.6B, Evaluation Protocol=0-shot2026.03 | 69.39 | |
| LFM2 1.2BParameter Count=1.2B, Evaluation Protocol=0-shot2026.03 | 66.09 | |
| MobileLLM-Flash 650MParameter Count=650M, Evaluation Protocol=0-shot2026.03 | 64.77 | |
| LFM2 350MParameter Count=350M, Evaluation Protocol=0-shot2026.03 | 64.37 | |
| Gemma3 1BParameter Count=1B, Evaluation Protocol=0-shot2026.03 | 63.2 | |
| Llama3.2 1BParameter Count=1B, Evaluation Protocol=0-shot2026.03 | 62.51 | |
| MobileLLM-Flash 350MParameter Count=350M, Evaluation Protocol=0-shot2026.03 | 62.39 | |
| Gemma3 270MParameter Count=270M, Evaluation Protocol=0-shot2026.03 | 58.17 |