Factual Knowledge on mParaRel English (all)
77.7AccuracyQwen 3 1.7B
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen 3 1.7BModel=Qwen 3 1.7B2025.12 | 77.7 | |
| Qwen 3 0.6BModel=Qwen 3 0.6B2025.12 | 73.9 | |
| SmolLM2 360MModel=SmolLM2 360M2025.12 | 72.4 | |
| Gemma 3 1BModel=Gemma 3 1B2025.12 | 71.9 | |
| 2× 100%Model=2× 100%2025.12 | 71.5 | |
| 1× 80%Model=1× 80%2025.12 | 70.3 | |
| 1× 100%Model=1× 100%2025.12 | 70.1 | |
| SmolLM2 135MModel=SmolLM2 135M2025.12 | 69.8 | |
| Gemma 3 270MModel=Gemma 3 270M2025.12 | 64.9 |