Russian culture-specific multiple-choice evaluation on RuBIN
35.2RuBIN ScoreGamayun
Evaluation Results
| Method | Links | |
|---|---|---|
| GamayunNumber of Parameters=1.5B2025.12 | 35.2 | |
| QVikhrBase Model=Qwen32025.12 | 33 | |
| Qwen2.5Number of Parameters=1.5B2025.12 | 32 | |
| Qwen3Number of Parameters=1.7B2025.12 | 32 | |
| ruadaptBase Model=Qwen2.52025.12 | 31 | |
| meno-tiny-0.1Base Model=Qwen32025.12 | 29 | |
| Llama3.2Number of Parameters=1.24B2025.12 | 25 | |
| VikhrLlamaBase Model=Llama3.22025.12 | 25 |