Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Medical Question Answering research benchmarks – Page 5 · SOTA2 Research

Medical Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Anatomy German (test)

DeFineMed-Mistral-Small-24B-SLERP

68.89Accuracy

11

Apr 23, 2026

141-question pharmacy dataset (test)

0.92Accuracy

11

Feb 26, 2026

76.4Accuracy

10

Jun 8, 2026

98Calibrated Accuracy

10

Jun 2, 2026

LLMMed-Eval Medical

79.61Score

10

May 29, 2026

HealthBench Medical

56.36Score

10

May 29, 2026

66.61Accuracy

10

May 26, 2026

Qwen2.5-7B + PPO w/ VERL.

71Pass@1

10

Apr 14, 2026

0.843Accuracy

10

Mar 31, 2026

4.06Tau (τ)

10

Mar 11, 2026

4.32Tau (τ)

10

Mar 11, 2026

4.03Kendall's Tau

10

Mar 11, 2026

4.34Kendall's Tau (τ)

10

Mar 11, 2026

Embedding Diversity

58.7Accuracy

10

Jun 26, 2026

Out-of-domain medical QA History, Engineering, Law (test)

50.4History Accuracy

10

Feb 26, 2026

PubMedQA Reasoning Required

GPT-4 (Medprompt)

82Accuracy

10

Feb 26, 2026

MedQA In-Distribution

92.19Accuracy

9

May 15, 2026

MedQA, MedMCQA, PubMedQA, MMLU-Pro-med, GPQA-med held-out (test)

57.61Accuracy (MedQA)

9

Apr 28, 2026

MedMCQA 100 sampled

83Accuracy

9

Apr 21, 2026

92Accuracy

9

Apr 8, 2026

MedXpertQA Path

Patho-AgenticRAG

60Accuracy

9

Mar 23, 2026

Multi-Agent Medical Decision Consensus Matrix System

91.3Accuracy

9

Feb 26, 2026

MedMCQA translated (test)

43.2Accuracy (ZH)

9

Feb 26, 2026

MMedBench 1.0 (test)

84.47Chinese Accuracy

9

Feb 26, 2026

92.5GPT-4 Score

9

Feb 26, 2026

Page 5 of 9

Popular datasets

MedQA PubMedQA MedMCQA HealthBench MedXpertQA

Follow for updates

Join SOTA2 Contact