Multilingual Language Proficiency on INCLUDE base-44
64.8Average ScoreBielik-11B-v3-Instruct
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Bielik-11B-v3-InstructParams (B)=112026.03 | 64.8 | 69 | |
| Bielik-11B-v3.0-InstructParams (B)=11.22026.04 | 64.8 | 69 | |
| Qwen2.5-14B-InstructParams (B)=142026.03 | 61.7 | 58.9 | |
| Qwen2.5-14B-InstructParams (B)=14.82026.04 | 61.7 | 58.9 | |
| Bielik-11B-v3.0Params (B)=112026.03 | 60.6 | 63.9 | |
| Bielik-11B-v3-Base-20250730Params (B)=11.22026.04 | 60.6 | 63.9 | |
| phi-4Params (B)=152026.03 | 58.8 | 49.6 | |
| phi-4Params (B)=14.72026.04 | 58.8 | 49.6 | |
| Apertus-8B-Instruct-2509Params (B)=82026.03 | 57.9 | 49.6 | |
| Apertus-8B-Instruct-2509Params (B)=8.02026.04 | 57.9 | 49.6 | |
| Bielik-Minitron-7B-v3.0-InstructParams (B)=72026.03 | 57.4 | 59.3 | |
| Bielik-Minitron-7B-v3.0-InstructParams (B)=7.52026.04 | 57.4 | 59.3 | |
| Llama-3.1-8B-InstructParams (B)=82026.03 | 55.3 | 53.8 | |
| Llama-3.1-8B-InstructParams (B)=8.02026.04 | 55.3 | 53.8 | |
| EuroLLM-9B-InstructParams (B)=92026.03 | 55.1 | 52 | |
| EuroLLM-9B-InstructParams (B)=9.22026.04 | 55.1 | 52 | |
| Qwen2.5-7B-InstructParams (B)=72026.03 | 54.4 | 52.2 | |
| Qwen2.5-7B-InstructParams (B)=7.62026.04 | 54.4 | 52.2 | |
| Bielik-PL-11B-v3.0-InstructParams (B)=11.22026.04 | 53.92 | 64.23 | |
| Mistral-Nemo-Instruct-2407Params (B)=122026.03 | 53.2 | 48.4 | |
| Mistral-Nemo-Instruct-2407Params (B)=12.22026.04 | 53.2 | 48.4 | |
| Bielik-11B-v2.6-InstructParams (B)=112026.03 | 51.5 | 59.3 | |
| Bielik-11B-v2.6-InstructParams (B)=11.22026.04 | 51.5 | 59.3 | |
| Mistral-Nemo-Base-2407Params (B)=122026.03 | 51.2 | 44.9 | |
| Mistral-Nemo-Base-2407Params (B)=12.22026.04 | 51.2 | 44.9 | |
| Bielik-PL-Minitron-7B-v3.0-InstructParams (B)=7.52026.04 | 49.81 | 59.49 | |
| EuroLLM-9BParams (B)=92026.03 | 49.2 | 45.6 | |
| EuroLLM-9BParams (B)=9.22026.04 | 49.2 | 45.6 | |
| aya-expanse-8bParams (B)=82026.03 | 45.3 | 46.4 | |
| Mistral-7B-Instruct-v0.2Params (B)=72026.03 | 45.3 | 44.7 | |
| aya-expanse-8bParams (B)=8.02026.04 | 45.3 | 46.4 | |
| Mistral-7B-Instruct-v0.2Params (B)=7.02026.04 | 45.3 | 44.7 | |
| Bielik-11B-v2Params (B)=112026.03 | 44.8 | 53.5 | |
| Bielik-11B-v2Params (B)=11.22026.04 | 44.8 | 53.5 | |
| pllum-12b-nc-chat-250715Params (B)=122026.03 | 44.2 | 60.6 | |
| pllum-12b-nc-chat-250715Params (B)=12.02026.04 | 44.2 | 60.6 | |
| Mistral-7B-v0.2Params (B)=72026.03 | 41.8 | 37.2 | |
| Mistral-7B-v0.2Params (B)=7.02026.04 | 41.8 | 37.2 | |
| pllum-12b-nc-base-250715Params (B)=122026.03 | 37.8 | 52.7 | |
| pllum-12b-nc-base-250715Params (B)=12.02026.04 | 37.8 | 52.7 | |
| Bielik-4.5B-v3.0Params (B)=4.52026.03 | 35.9 | 48.7 | |
| Bielik-4.5B-v3Params (B)=4.82026.04 | 35.9 | 48.7 | |
| PLLuM-12B-base-250801Params (B)=122026.03 | 35.5 | 44.5 | |
| PLLuM-12B-base-250801Params (B)=12.02026.04 | 35.5 | 44.5 | |
| Llama-PLLuM-8B-base-250801Params (B)=82026.03 | 30 | 37.2 | |
| Llama-PLLuM-8B-base-250801Params (B)=8.02026.04 | 30 | 37.2 |