MedQA
Benchmarks
TaskDatasetSOTA resultTrendResults
MedQA
89.41Accuracy
179
MedQA
93.88Accuracy
153
MedQA
86.5Accuracy
145
MedQA-USMLE (test)
94.34Accuracy
101
MedQA
94.8Accuracy
96
MedQA
71.72Accuracy
86
MedQA (test)
89.55Accuracy
67
MedQA
92.8Accuracy
61
MedQA
72F1 Score (%)
50
MedQA US
90.42Accuracy
43
MedQA
55.6EM Accuracy
42
MedQA
50.98Accuracy
39
MedQA standard (test)
94Accuracy
32
MedQA
68.69Accuracy
32
MedQA
83.76Accuracy
30
MedQA
6.47Match Rate (MAT)
30
MedQA
89.8Decision-Useful Rate
30
MedQA
94.2Accuracy
30
MedQA
85.8Accuracy
28
MedQA (test)
92Accuracy
28
MedQA
78.3Accuracy
27
MedQA USMLE
87.4Accuracy
27
MedQA 5 opts
87Accuracy
26
MedQA agent
9.11Rounds
25
MedQA
72.9Accuracy
24