Multiple-choice QA on Kazakh socio-cultural MC QA (test)
37.1Accuracyqwen-1.5b
Evaluation results
| Method | Links | |
|---|---|---|
| qwen-1.5bParams=2B, Zero-shot=true2026.03 | 37.1 | |
| llama-3-3bParams=3B, Zero-shot=true2026.03 | 34.2 | |
| gemma-2bParams=2B, Zero-shot=true2026.03 | 32.5 | |
| llama-3-1bParams=1B, Zero-shot=true2026.03 | 32 | |
| qwen-0.5bParams=500M, Zero-shot=true2026.03 | 31.5 | |
| sozkz-600mParams=600M, Zero-shot=true2026.03 | 30.3 | |
| sozkz-300mParams=300M, Zero-shot=true2026.03 | 28.3 | |
| sozkz-150mParams=150M, Zero-shot=true2026.03 | 24.7 |