Linguistic Acceptability on BLiMP English (all)
81.6AccuracyQwen 3 1.7B
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen 3 1.7BModel=Qwen 3 1.7B2025.12 | 81.6 | |
| SmolLM2 360MModel=SmolLM2 360M2025.12 | 81.4 | |
| 2× 100%Model=2× 100%2025.12 | 80.6 | |
| Qwen 3 0.6BModel=Qwen 3 0.6B2025.12 | 80.5 | |
| SmolLM2 135MModel=SmolLM2 135M2025.12 | 80.4 | |
| 1× 100%Model=1× 100%2025.12 | 79.7 | |
| 1× 80%Model=1× 80%2025.12 | 79.5 | |
| Gemma 3 270MModel=Gemma 3 270M2025.12 | 79.1 | |
| Gemma 3 1BModel=Gemma 3 1B2025.12 | 78.5 |