Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Medical Question Answering research benchmarks – Page 4 · SOTA2 Research

Medical Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Tongyi-DeepResearch-30BA3B

28.19Accuracy

13

Feb 26, 2026

0.22Base Deviation

13

Feb 26, 2026

0.12Base Accuracy Std Dev

13

Feb 26, 2026

66.8Accuracy

12

Jun 16, 2026

85.49Accuracy

12

May 28, 2026

88.89Accuracy

12

May 28, 2026

HealthBench Hard 1000

Claude Sonnet 4.6

86Accuracy

12

May 8, 2026

MMLU-Med MIRAGE

MEDVRAG (full system)

88.6Accuracy

12

May 1, 2026

92.1Accuracy

12

Apr 6, 2026

SuperGPQA Clinical

35.71Accuracy

12

Mar 16, 2026

Huatuo-26M-Lite-100

83.25Win Rate

12

Feb 26, 2026

Huatuo-26M Lite

66.38Win Rate

12

Feb 26, 2026

88.18Wins

12

Feb 26, 2026

Huatuo-26M-Lite-100 (test)

93Wins

12

Feb 26, 2026

Huatuo-26M-Lite (test)

59.31Win Rate

12

Feb 26, 2026

89.65Win Rate

12

Feb 26, 2026

CV-MedExQA ambiguous (test)

73.09Accuracy

12

Feb 26, 2026

CV-MedQA ambiguous (test)

0.764Accuracy

12

Feb 26, 2026

Standard Questions

20.25Baseline Wins (%)

12

Feb 26, 2026

89.44MMLU-Med

12

Feb 26, 2026

VitalBench Tier B (670) (test)

65.2Overall Accuracy

11

May 29, 2026

VitalBench Tier A (635) (test)

86Overall Accuracy

11

May 29, 2026

MedQA-de (test)

DeFineMed-Mistral-Small-24B-SLERP

70.2Accuracy

11

Apr 23, 2026

College Medicine German (test)

DeFineMed-Mistral-Small-24B-SLERP

78.03Accuracy

11

Apr 23, 2026

Clinical Knowledge German (test)

DeFineMed-Mistral-Small-24B-SLERP

82.64Accuracy

11

Apr 23, 2026

Page 4 of 9

Popular datasets

MedQA PubMedQA MedMCQA HealthBench MedXpertQA

Follow for updates

Join SOTA2 Contact