Language Understanding on INCLUDE base 44
64.8Average ScoreBielik-11B-v3-Instruct
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Bielik-11B-v3-InstructParams (B)=112025.12 | 64.8 | 69 | |
| Qwen2.5-14B-InstructParams (B)=142025.12 | 61.7 | 58.9 | |
| Bielik-11B-v3Params (B)=112025.12 | 60.6 | 63.9 | |
| phi-4Params (B)=152025.12 | 58.8 | 49.6 | |
| Apertus-8B-Instruct-2509Params (B)=82025.12 | 57.9 | 49.6 | |
| Llama-3.1-8B-InstructParams (B)=82025.12 | 55.3 | 53.8 | |
| EuroLLM-9B-InstructParams (B)=92025.12 | 55.1 | 52 | |
| Qwen2.5-7B-InstructParams (B)=72025.12 | 54.4 | 52.2 | |
| Mistral-Nemo-Instruct-2407Params (B)=122025.12 | 53.2 | 48.4 | |
| Bielik-11B-v2.6-InstructParams (B)=112025.12 | 51.5 | 59.3 | |
| Mistral-Nemo-Base-2407Params (B)=122025.12 | 51.2 | 44.9 | |
| EuroLLM-9BParams (B)=92025.12 | 49.2 | 45.6 | |
| aya-expanse-8bParams (B)=82025.12 | 45.3 | 46.4 | |
| Mistral-7B-Instruct-v0.2Params (B)=72025.12 | 45.3 | 44.7 | |
| Bielik-11B-v2Params (B)=112025.12 | 44.8 | 53.5 | |
| pllum-12b-nc-chat-250715Params (B)=122025.12 | 44.2 | 60.6 | |
| Mistral-7B-v0.2Params (B)=72025.12 | 41.8 | 37.2 | |
| pllum-12b-nc-base-250715Params (B)=122025.12 | 37.8 | 52.7 | |
| Bielik-4.5B-v3Params (B)=4.52025.12 | 35.9 | 48.7 | |
| PLLuM-12B-base-250801Params (B)=122025.12 | 35.5 | 44.5 | |
| Llama-PLLuM-8B-base-250801Params (B)=82025.12 | 30 | 37.2 |