MedQA
Benchmarks
TaskDatasetSOTA resultTrendResults
MedQA
92.59Accuracy
23
MedQA
77.9nDCG@10
23
MedQA USMLE
90.4Accuracy
21
MedQA (dev)
77.6Accuracy
21
MedQA
86.8Pass@1
20
MedQA 4-option original (test)
95.1Accuracy
20
MedQA
92.8Accuracy
20
MedQA
64.57Accuracy
18
MedQA US (test)
90.02Accuracy
18
MedQA
61.29Accuracy
18
MedQA
42.75HS
17
medqa
0.038MAE
16
MedQA
24.6Privacy Score
16
MedQA
31.3ASR (500)
16
MedQA USMLE-style
73.02Accuracy
15
MedQA (OOD)
20EM
14
NEJM-MedQA
86.7Accuracy
14
MedQA 5-options Full (test)
83.6Accuracy
14
MedQA (test)
97.9Accuracy
13
NEJM-MedQA
0.22Base Deviation
13
MedQA (M-QA)
0.12Base Accuracy Std Dev
13
MedQA
83.89Q Score
12
MedQA
66.8Accuracy
12
MedQA
95.65Accuracy (Q)
12
MedQA CN
85.49Accuracy
12