MERLIN
Benchmarks
TaskDatasetSOTA resultTrendResults
Merlin
0.39BLEU-1
14
Merlin (test)
35.64RaTE Score
14
Merlin dataset
52.63Micro Precision
14
Merlin-Abd-CT
65.25Recall@1
13
Merlin-Abd-CT
64Recall@1
13
Merlin-Abd-CT
82.44AUROC
12
Merlin Impressions section (test)
43.2Recall@1
12
Merlin Findings section (test)
77.6Recall@1
12
Merlin (val)
70.7Recall@1 (Findings)
9
Merlin
0.369Pearson Correlation
7
Merlin Full Report (test)
66.4Recall@1
6
MERLIN (test)
0.83AUROC
6
Merlin
81AUROC
5
Merlin (internal val)
84.3F1 Score
5
Merlin
88.8Recall@1
4
Merlin (test)
86.9Precision
4
MERLIN N = 5,082 (Internal)
88AUC
4
Merlin
9BLEU-2
3
Merlin n=5,082
22.5Recall@5
3
Merlin Images (random)
48.6Pos-Orig Score
2
Merlin Curated Images
34.3Positive Original Accuracy
2
MERLIN
71.3AP
2
Merlin neg
60.5BLEU-2
1
Merlin pos
29.8BLEU-2
1