List your company
ResearchFormerly WizWand

Multiple Choice Question Answering on MMLU-Pro (Professional Medicine)

94AccuracyGPT-4o
36.48851.41966.3581.281Mar 29, 2022Nov 17, 2022Jul 8, 2023Feb 26, 2024Oct 16, 2024Jun 6, 2025Jan 26, 2026
Updated 8mo ago

Evaluation results

MethodLinks
GPT-4oPrompting (shots)=0-shot2024.1094
GPT-4oPrompting (shots)=5-shot2024.1094
GPT-4T (May 2024)Prompting (shots)=0-shot2024.1092
GPT-4T (May 2024)Prompting (shots)=5-shot2024.1092
Gemini2.5-ProModel Group=Awesome General Models2026.0184.3
Deepseek-v3.2-685BModel Group=Awesome General Models2026.0183.19
Kimi-K2-Thinking-1TBModel Group=Awesome General Models2026.0182.74
DEEPMED-14B-RLModel Group=DeepResearch Models, Training Stage=RL2026.0179.93
AlphaMed-70BModel Group=Medical Reasoning Models2026.0179.54
Tongyi-DeepResearch-30BA3BModel Group=DeepResearch Models2026.0179.54
DEEPMED-14B-SFTModel Group=DeepResearch Models, Training Stage=SFT2026.0177.92
Qwen3-30BA3B-ThinkingModel Group=Awesome General Models2026.0176.94
HuatuoGPT-o1-70BModel Group=Medical Reasoning Models2026.0176.61
BaiChuan-M2-32BModel Group=Medical Reasoning Models2026.0175.05
Qwen3-14BModel Group=Awesome General Models2026.0174.53
M1-1K-32BModel Group=Medical Reasoning Models2026.0171.53
M1-1K-7BModel Group=Medical Reasoning Models2026.0165.73
MedResaon-8BModel Group=Medical Reasoning Models2026.0163.13
BioLinkBERT_largeNumber of Parameters=340M2022.0350.7
UnifiedQANumber of Parameters=11B2022.0343.2
GPT-3Number of Parameters=175B2022.0338.7