MedXpertQA
Benchmarks
TaskDatasetSOTA resultTrendResults
MedXpertQA
56Accuracy
52
MedXpertQA Multimodal modality (offline)
54.73Accuracy
38
MedXpertQA Text modality (offline)
46.49Accuracy
38
MedXpertQA-MM
62.4Accuracy
38
MedXpertQA standard (test)
41.7Accuracy
32
MedXpertQA
22.2Accuracy
31
MedXpertQA (test)
8.49ETS Score
23
MedXpertQA
42.9Accuracy
20
MedXpertQA-U
12.39Pass@1
18
MedXpertQA Pathology 90 samples
25.56Accuracy
18
MedXpertQA OOD (test)
0.184ECE
15
MedXpertQA OOD (test)
69.2Accuracy
15
MedXpertQA (OOD)
22.97Exact Match (EM)
14
MedXpertQA Expert 2450
72Accuracy
13
MedXpertQA text
48.9Accuracy
12
MedXpertQA Path
80Accuracy
10
MedXpertQA
7.52EM
9
MedXpertQA Path
60Accuracy
9
MedXpertQA
15.25Accuracy
8
MedXpertQA (test)
44.5Accuracy
8
MedXpertQA OOD Text-only
54.6Accuracy (OOD Text-only)
7
MedXpertQA Text
24.12Accuracy
6
MedXpertQA text + MM
74.4Accuracy (MedXpertQA Text+MM)
6
MedXpertQA Text Only
78.2Accuracy
6
MedXpertQA-Text
69.47Pass@1
4