Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Medical Question Answering research benchmarks – Page 8 · SOTA2 Research

Medical Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

HealthBench (All Set)

58.56Overall Score

4

Mar 24, 2026

100Success Rate (SR)

4

Mar 10, 2026

66.67Accuracy

4

Feb 26, 2026

53ROUGE-1

4

Feb 26, 2026

HealthBench normal

65.2Pass@1

4

Feb 26, 2026

96.12Pass@1

4

Feb 26, 2026

72.45Pass@1

4

Feb 26, 2026

94.16Pass@1

4

Feb 26, 2026

95.78Pass@1

4

Feb 26, 2026

97.88Pass@1

4

Feb 26, 2026

96.21Pass@1

4

Feb 26, 2026

MedXpertQA-Text

69.47Pass@1

4

Feb 26, 2026

77.2Pass@1

4

Feb 26, 2026

MedQA Mainland China

86Accuracy

4

Feb 26, 2026

91Accuracy

4

Feb 26, 2026

CAREPATH consensus clinical guidelines dementia

4PROMETHEUS-2 Average Score

3

Jul 3, 2026

56.7Health Score

3

Jun 30, 2026

HealthBench Consensus

90.9Score

3

Jun 23, 2026

MedQA first 100 questions (test)

Gemini Deep Research

99Accuracy (Web Search On)

3

Jun 5, 2026

MMLU medical diabetes

74.7Accuracy

3

Mar 5, 2026

88Accuracy

3

Mar 5, 2026

MedMCQA diabetes

76.5Accuracy

3

Mar 5, 2026

63.41Char Deletion Robustness

3

Feb 26, 2026

Medical QA offline evaluation

Uni-Normalize Scheme

0.83Honesty

3

Feb 26, 2026

Aggregate MedQA MedMCQA PubMedQA MMLU

86.7Accuracy

3

Feb 26, 2026

Page 8 of 9

Popular datasets

MedQA PubMedQA MedMCQA HealthBench MedXpertQA

Follow for updates

Join SOTA2 Contact