MIMIC-CXR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MIMIC-CXR Edema vs. Pneumonia (test)
70.9Accuracy
15
MIMIC-CXR (test)
41.896Recall@5
15
MIMIC-CXR 72 (test)
0.385BLEU-1
15
MIMIC-CXR
31.4ROUGE-L
15
MIMIC-CXR (test)
71.92AUC
14
MIMIC-CXR
1.21Params
13
MIMIC-CXR
52.6RaTE
13
MIMIC-CXR
6.04Accuracy
13
MIMIC-CXR
44.7R@1
13
MIMIC-CXR MAIRA (test)
51.6Macro F1
12
MIMIC-CXR Med-Gemini (test)
90.7Macro F1
12
MIMIC-CXR (test)
1,996R@1
12
MIMIC-CXR Findings generation v1.5 (Vicuna-7B)
26.1ROUGE-L
12
MIMIC-CXR (10% forget set)
100MIA
12
MIMIC-CXR (6% forget set)
100MIA
12
MIMIC-CXR (3% forget set)
1MIA
12
MIMIC-CXR curated subset of 1,000 samples (test)
0.425BLEU-1
11
MIMIC-CXR FINDINGS section (test)
30.6ROUGE-L
11
MIMIC-CXR Gender
30.38ES-BLEU-1
11
MIMIC-CXR Age Group
21.89ES-BLEU-1
11
MIMIC-CXR Race
13.36ES-BLEU-1
11
MIMIC-CXR
93Accuracy
10
MIMIC-CXR
91Accuracy
10
MIMIC-CXR (test)
0.827AUROC
10
MIMIC-CXR (impression)
0.214BLEU-1
10