Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Medical Question Answering research benchmarks – Page 9 · SOTA2 Research

Medical Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

MedQA (matched 500)

94.2Score

2

Jun 23, 2026

HealthBench oss_eval (full)

Ideal completions

47Overall Score

2

Jun 23, 2026

MedQA (held-out)

Self-Consistency

10SC@10 Score

2

May 8, 2026

Reporting-and-penalty mechanism

100Accuracy under Attack

2

Apr 28, 2026

MedMCQA 200 samples

Brainstacks (Routed)

0.36Log-likelihood Score

2

Apr 2, 2026

MedQA 200 samples

Gemma 3 12B IT (Base)

0.385Log-likelihood Score

2

Apr 2, 2026

MIMIC-III (test)

GPT-4 (Baseline)

67.05CUS Score

2

Apr 1, 2026

66CUS Score

2

Apr 1, 2026

31CUS

2

Apr 1, 2026

25.53Accuracy

2

Feb 26, 2026

73.7Accuracy (MedB-4)

2

Feb 26, 2026

70.15Accuracy

2

Feb 26, 2026

OmniMed MRI Banding (test)

72.39Accuracy

2

Feb 26, 2026

OmniMed MRI Aliasing (test)

53.07Accuracy

2

Feb 26, 2026

OmniMed MRI Human Motion (test)

70.55Accuracy

2

Feb 26, 2026

89.3Query Intent Fulfillment

2

Feb 26, 2026

OmniMed MRI Original (test)

0.736Accuracy

1

Feb 26, 2026

Page 9 of 9

Popular datasets

MedQA PubMedQA MedMCQA HealthBench MedXpertQA

Follow for updates

Join SOTA2 Contact