Medical Question Answering on Polish Board Certification Examinations
69.2Average ScoreMeta-Llama-3.1-405B-Instruct-FP8
Evaluation Results
| Method | Links | |
|---|---|---|
| Meta-Llama-3.1-405B-Instruct-FP8Parameters (B)=405.0, Shot setting=5-shot2026.03 | 69.2 | |
| Mistral-Large-Instruct-2407†Parameters (B)=123.0, Shot setting=5-shot2026.03 | 64.28 | |
| Qwen2.5-72B-InstructParameters (B)=72.7, Shot setting=5-shot2026.03 | 63.89 | |
| Meta-Llama-3.1-70B-InstructParameters (B)=70.6, Shot setting=5-shot2026.03 | 61.75 | |
| Qwen2-72B-InstructParameters (B)=72.7, Shot setting=5-shot2026.03 | 61.35 | |
| Meta-Llama-3-70B-InstructParameters (B)=70.6, Shot setting=5-shot2026.03 | 57.51 | |
| Qwen2.5-32BParameters (B)=32.8, Shot setting=5-shot2026.03 | 55.69 | |
| Qwen2.5-32B-InstructParameters (B)=32.8, Shot setting=5-shot2026.03 | 54.52 | |
| Bielik-11B-v3.0-InstructParameters (B)=11.2, Shot setting=5-shot2026.03 | 50.21 | |
| Qwen2.5-14B-InstructParameters (B)=14.8, Shot setting=5-shot2026.03 | 49.6 | |
| Bielik-11B-v3-Base-20250730Parameters (B)=11.2, Shot setting=5-shot2026.03 | 45.86 | |
| Bielik-11B-v2.6-InstructParameters (B)=11.2, Shot setting=5-shot2026.03 | 44.88 | |
| Bielik-11B-v2.5-InstructParameters (B)=11.2, Shot setting=5-shot2026.03 | 44.85 | |
| GLM-4-9b-chatParameters (B)=9.0, Shot setting=5-shot2026.03 | 44.54 | |
| Bielik-Minitron-7B-v3.0-InstructParameters (B)=7.35, Shot setting=5-shot2026.03 | 44.36 | |
| Mistral-Small-Instruct-2409Parameters (B)=22.2, Shot setting=5-shot2026.03 | 43.6 | |
| Bielik-4.5B-v3.0-InstructParameters (B)=4.8, Shot setting=5-shot2026.03 | 43.55 | |
| Bielik-11B-v2.3-InstructParameters (B)=11.2, Shot setting=5-shot2026.03 | 43.26 | |
| Bielik-11B-v2.1-InstructParameters (B)=11.2, Shot setting=5-shot2026.03 | 43.16 | |
| Bielik-11B-v2.2-InstructParameters (B)=11.2, Shot setting=5-shot2026.03 | 43.05 | |
| Qwen2.5-7B-InstructParameters (B)=7.6, Shot setting=5-shot2026.03 | 42.69 | |
| Bielik-11B-v2.0-InstructParameters (B)=11.2, Shot setting=5-shot2026.03 | 41.53 | |
| Meta-Llama-3.1-8B-InstructParameters (B)=8.0, Shot setting=5-shot2026.03 | 40.6 | |
| Mistral-Nemo-Instruct-2407Parameters (B)=12.2, Shot setting=5-shot2026.03 | 40.36 | |
| Bielik-11B-v2Parameters (B)=11.2, Shot setting=5-shot2026.03 | 39.98 | |
| PLLuM-12B-nc-chat-250715†Parameters (B)=12.2, Shot setting=5-shot2026.03 | 38.53 | |
| PLLuM-12B-chatParameters (B)=12.2, Shot setting=5-shot2026.03 | 36.51 | |
| EuroLLM-9B-InstructParameters (B)=9.0, Shot setting=5-shot2026.03 | 35.96 | |
| Mistral-7B-Instruct-v0.3Parameters (B)=7.0, Shot setting=5-shot2026.03 | 31.24 | |
| Bielik-7B-Instruct-v0.1Parameters (B)=7.2, Shot setting=5-shot2026.03 | 29.74 |