IU-Xray
Benchmarks
TaskDatasetSOTA resultTrendResults
IU-Xray (test)
0.448ROUGE-L
116
IU-Xray (test)
0.463ROUGE-L
56
IU-Xray (test)
48BLEU-1
47
IU-XRay (test)
96.05Accuracy
40
IU-XRay (test)
97.78Accuracy
40
IU-Xray
41.1ROUGE-L Score
38
IU-Xray (Close)
86.22Accuracy
22
IU-XRay
85.71Factual Consistency (FC)
20
IU-XRay
97.16Task Utility
20
IU-XRay
95.92Task Utility
20
IU-Xray
90.33Accuracy
20
IU-Xray
44.9ROUGE-L
17
IU-Xray
0.899PR AUC
16
IU-Xray
41.59BLEU-1
13
IU-Xray
60.5RaTE
13
IU-Xray
7.48Accuracy
13
IU-Xray Findings generation v1.5 (Vicuna-7B)
28.4ROUGE-L
12
IU-Xray
10.31BLEU
11
IU-Xray
64.71Composite Score
10
IU-Xray
33.1ROUGE-L
10
IU-Xray (test)
0.908Average AUC
10
IU-Xray (full dataset)
0.439BLEU-1
9
IU-XRay
0.53BLEU-1
8
IU-Xray
0.592BLEU-1
8
IU-Xray OOD (test)
28.47BLEU-1
7