Multitask Language Understanding on MMLU Medical Genetics FR (test) benchmark leaderboard · SOTA2 Research

Multitask Language Understanding on MMLU Medical Genetics FR (test)

86AccuracyMedGemma-27B-it

Evaluation Results

Method	Links
MedGemma-27B-it2026.04		86
Qwen3-32B2026.04		85
Qwen3-8B-Base2026.04		80
Qwen3-8B2026.04		80
Qwen3-14B2026.04		80
Qwen3-4B-Base2026.04		74
Qwen3-4B2026.04		69
Llama3.1-8B-Instruct2026.04		68
Llama3.2-1B2026.04		67
Llama3.1-8B2026.04		67
Apollo-7B2026.04		67
Qwen3-1.7B-Base2026.04		66
Gaperon-8B2026.04		65
MedGemma-4B-it2026.04		65
Apertus-8B2026.04		64
EuroLLM-9B-Instruct2026.04		64
GPT-OSS-20B2026.04		64
Olmo3-7B2026.04		63
EuroLLM-9B2026.04		62
Qwen3-1.7B2026.04		62
Apertus-8B-Instruct2026.04		62
Mistral-7B-Instruct-v0.32026.04		60
Mistral-7B-v0.32026.04		59
SmolLM-3B2026.04		58
MedGemma-4B-pt2026.04		48
BioMistral-7B2026.04		48
Qwen3-0.6B-Base2026.04		47
Llama3.2-1B-Instruct2026.04		46
Gemma3-1B-it2026.04		44
Qwen3-0.6B2026.04		38
Gemma3-270m-it2026.04		28
Gaperon-1B2026.04		27
Gemma3-1B-pt2026.04		26
Baguettotron2026.04		24
Gemma3-270m-pt2026.04		23