MedQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MedQA
96BERT Inference Attack Success Rate
9
MedQA (test)
0.635AUROC
9
MedQA (test)
51Accuracy
8
MedQA
62.3Agreement
8
MedQA
82.72Accuracy
8
MedQA
65.78Accuracy
8
MedQA (test)
85SM
8
MedQA Multimodal
66.54Accuracy
8
MedQA
87Cumulative Score (CS)
8
MedQA MCMLE
83.95Accuracy
8
MedQA US (4-option)
90.2Accuracy
8
MedQA
83.74Accuracy
7
MedQA-open (test)
1.32CCor
7
MedQA ID (in-distribution)
80.8Accuracy
7
MedQA (test)
72.82EM Accuracy
7
MedQA
1.5KL Divergence
7
MedQA QF=100
91.33Forget Accuracy
7
MedQA USMLE
86.17Accuracy
6
MedQA
40.25Score
6
MedQA
38.84ROUGE-1
6
MedQA Extension (test)
92.3Accuracy
6
MedQA
83.3Acc/EM
6
MedQA D1 N=500 (test)
95.2HYB Score
5
MedQA-USMLE
56.95Accuracy
5
MedQA
77.4Preference Alignment
5