Linguistic and Cultural Competency on Polish Linguistic and Cultural Competency Benchmark (PLCC)
95.83Avg ScoreGemini-3.0-Pro-Preview
Evaluation Results
| Method | Links | |
|---|---|---|
| Gemini-3.0-Pro-PreviewParameters (B)=Unknown2025.12 | 95.83 | |
| Gemini-2.5-Pro-Exp-03-25Parameters (B)=Unknown2025.12 | 89.5 | |
| Claude-3.7-SonnetParameters (B)=Unknown2025.12 | 81.5 | |
| GPT-5.1-2025-11-13 (default reasoning)Parameters (B)=Unknown2025.12 | 77.83 | |
| Gemini-2.0-Flash-ExperimentalParameters (B)=Unknown2025.12 | 74.17 | |
| O4-Mini-2025-04-16Parameters (B)=Unknown2025.12 | 72.83 | |
| Bielik-11B-v3.0-InstructParameters (B)=11.22025.12 | 71.83 | |
| Kimi-K2-ThinkingParameters (B)=10002025.12 | 71.67 | |
| Claude-Sonnet-4.5Parameters (B)=Unknown2025.12 | 71 | |
| DeepSeek-v3-0324Parameters (B)=685.02025.12 | 71 | |
| GLM-4.6Parameters (B)=3552025.12 | 70.67 | |
| Grok-4-FastParameters (B)=Unknown2025.12 | 70.17 | |
| Gemini-Pro-1.5Parameters (B)=Unknown2025.12 | 69.67 | |
| PLLuM-12B-nc-chat-250715Parameters (B)=12.22025.12 | 69.67 | |
| DeepSeek-v3Parameters (B)=685.02025.12 | 69.17 | |
| PLLuM-8x7B-nc-chatParameters (B)=46.72025.12 | 68.17 | |
| Bielik-11B-v2.6-InstructParameters (B)=11.22025.12 | 65.5 | |
| GPT-4.1-mini-2025-04-14Parameters (B)=Unknown2025.12 | 62.17 | |
| Llama-3.1-405BParameters (B)=405.02025.12 | 60 | |
| PLLuM-12B-nc-chatParameters (B)=12.22025.12 | 59.5 | |
| Llama-PLLuM-70B-chatParameters (B)=70.62025.12 | 58.5 | |
| Llama-4-MaverickParameters (B)=402.02025.12 | 58.17 | |
| Command-A-03-2025Parameters (B)=111.02025.12 | 56.17 | |
| Mistral-Large-2407Parameters (B)=123.02025.12 | 54.17 | |
| PLLuM-8x7B-chatParameters (B)=46.72025.12 | 54.17 | |
| WizardLM-2-8x22BParameters (B)=141.02025.12 | 51.5 | |
| Qwen-MaxParameters (B)=Unknown2025.12 | 50.83 | |
| Command-R-Plus-08-2024Parameters (B)=Unknown2025.12 | 50.17 | |
| Mixtral-8x22BParameters (B)=141.02025.12 | 49.83 | |
| Llama-3.3-70BParameters (B)=70.62025.12 | 48.83 | |
| Gemma-3-27BParameters (B)=27.42025.12 | 47.33 | |
| PLLuM-12B-chatParameters (B)=12.22025.12 | 47 | |
| Bielik-7B-Instruct-v0.1Parameters (B)=7.22025.12 | 46.67 | |
| Mistral-Small-3.1-24B-2503Parameters (B)=24.02025.12 | 43.33 | |
| Llama-3.0-70BParameters (B)=70.02025.12 | 43 | |
| Gemma-2-27BParameters (B)=27.02025.12 | 42.67 | |
| Llama-4-ScoutParameters (B)=109.02025.12 | 41.5 | |
| Bielik-4.5B-v3.0-InstructParameters (B)=4.82025.12 | 41.47 | |
| EuroLLM-9BParameters (B)=9.02025.12 | 41 | |
| Qwen-2.5-72BParameters (B)=72.72025.12 | 39.17 | |
| Mistral-Small-24B-2501Parameters (B)=24.02025.12 | 39 | |
| Llama-PLLuM-8B-chatParameters (B)=8.02025.12 | 38.5 | |
| Qwen3-32BParameters (B)=32.82025.12 | 37.67 | |
| Mixtral-8x7BParameters (B)=46.72025.12 | 35.33 | |
| GPT-OSS-20bParameters (B)=202025.12 | 32.3 | |
| Qwen-2.5-32BParameters (B)=32.82025.12 | 30.5 | |
| Gemma-2-9BParameters (B)=9.02025.12 | 29.17 | |
| Phi-4Parameters (B)=14.72025.12 | 29.17 | |
| Bielik-1.5B-v3.0-InstructParameters (B)=1.62025.12 | 27.5 | |
| Qwen-2.5-14BParameters (B)=14.82025.12 | 26.67 | |
| Mistral-NemoParameters (B)=12.22025.12 | 23 | |
| Mistral-7B-v0.3Parameters (B)=7.22025.12 | 21.83 |