List your company

Multiple-choice Question Answering on MMLU Medical Subjects (test)

92.36Accuracy (College Biology, EN)Qwen3-14B
17.968837.281956.59575.9081Apr 8, 2026

Evaluation results

MethodLinks
Qwen3-14BType=Instruct2026.0492.3689.5880.9278.03
Qwen3-32BType=Instruct2026.0490.2890.9782.0877.46
Qwen3-8B-BaseType=Base2026.0488.8987.578.0375.72
Qwen3-8BType=Instruct2026.0488.1985.4279.1973.41
MedGemma-27B-itType=BioMed2026.0485.4286.8172.8373.99
Qwen3-4B-BaseType=Base2026.0484.727573.9968.21
Qwen3-4BType=Instruct2026.0484.7273.6170.5273.99
Llama3.1-8B-InstructType=Instruct2026.0481.9467.3665.3263.01
Apollo-7BType=BioMed2026.0477.7862.559.5458.38
Llama3.2-1BType=Base2026.0477.0862.564.7459.54
Llama3.1-8BType=Base2026.0477.0862.564.7459.54
Olmo3-7BType=Base2026.0476.3953.4770.5250.87
Apertus-8B-InstructType=Instruct2026.047567.3661.2759.54
Qwen3-1.7B-BaseType=Base2026.0472.9254.1768.2159.54
Apertus-8BType=Base2026.0472.9268.7561.8557.8
SmolLM-3BType=Instruct2026.0472.9259.7264.1655.49
Mistral-7B-Instruct-v0.3Type=Instruct2026.0472.2259.0360.1254.34
EuroLLM-9B-InstructType=Instruct2026.0471.5371.5353.7654.34
GPT-OSS-20BType=Instruct2026.0470.8369.4454.3456.07
Mistral-7B-v0.3Type=Base2026.0470.1454.8663.0153.18
MedGemma-4B-itType=BioMed2026.0468.7554.8655.4956.65
Qwen3-1.7BType=Instruct2026.0467.3649.3161.8556.07
EuroLLM-9BType=Base2026.0466.6766.6754.3452.02
Gaperon-8BType=Base2026.0462.552.7847.445.09
Qwen3-0.6B-BaseType=Base2026.0459.7239.5852.640.46
MedGemma-4B-ptType=BioMed2026.0459.0348.6149.7142.77
BioMistral-7BType=BioMed2026.0459.0347.2253.7650.29
Qwen3-0.6BType=Instruct2026.0456.2534.0347.438.15
Llama3.2-1B-InstructType=Instruct2026.0446.5334.0336.9928.32
Gemma3-270m-itType=Instruct2026.0434.7222.9221.3921.39
Gemma3-1B-itType=Instruct2026.0434.7236.1139.3138.73
BaguettotronType=Base2026.0426.3918.0627.1723.12
Gemma3-1B-ptType=Base2026.0425.6927.0821.3921.97
Gaperon-1BType=Base2026.0422.9220.1420.8121.39
Gemma3-270m-ptType=Base2026.0420.8321.5323.719.65