Medical Reasoning on MMLU-Pro (Biology English)
77.7AccuracyQwen2.5-14B-Instruct
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen2.5-14B-InstructZero-shot=true2026.05 | 77.7 | |
| Qwen2.5-7B-InstructZero-shot=true2026.05 | 73.1 | |
| HuatuoGPT-o1-8BZero-shot=true2026.05 | 71 | |
| HiMed-8BBackbone=LLaMA-3.1-8B, Zero-shot=true2026.05 | 69.9 | |
| UltraMedical-8BBackbone=LLaMA-3, Zero-shot=true2026.05 | 66.8 | |
| LLaMA-3.1-8B-InstructZero-shot=true2026.05 | 66.7 | |
| MedReason-8BZero-shot=true2026.05 | 65.8 | |
| CURE-Med-7BZero-shot=true2026.05 | 65.8 | |
| GPT-4oZero-shot=true2026.05 | 61.9 | |
| Aya-23-8BZero-shot=true2026.05 | 49.1 | |
| AyurParamZero-shot=true2026.05 | 8.6 |