Multilingual Language Understanding on Russian Benchmarks
34.9Arc-ruGamayun
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| GamayunSize=1.47B2025.12 | 34.9 | 70.4 | 42.4 | 46.4 | 41.2 | 47.8 | 68.3 | 66.7 | 38.1 | 50.7 | |
| Qwen2.5Size=1.54B2025.12 | 29.2 | 71.3 | 37 | 52.9 | 47.5 | 45.1 | 63.1 | 66.7 | 35.7 | 49.8 | |
| EuroLMSize=1.7B2025.12 | 28.6 | 29.4 | 37.1 | 23.4 | 27.1 | 46 | 63.7 | 61 | 23.2 | 37.7 | |
| Qwen3Size=1.7B2025.12 | 28.2 | 67.9 | 35.6 | 52.9 | 50.3 | 40.6 | 59.1 | 62.2 | 36.4 | 48.1 | |
| Gemma3Size=1B2025.12 | 28.1 | 43 | 35.8 | 36.4 | 34.5 | 43.3 | 62.8 | 61.3 | 30 | 41.7 | |
| Llama3.2Size=1.24B2025.12 | 24.4 | 49.7 | 32.2 | 37 | 35.9 | 44 | 55.8 | 57.8 | 29.8 | 40.7 |