VQA-Med
Benchmarks
TaskDatasetSOTA resultTrendResults
VQA-Med Open
0.006ECE
192
VQA-Med Open
0.825AUROC
96
VQA-Med Closed
81.8AUROC
96
VQA-Med Closed
0.013ECE
96
VQA-Med 2019 (All)
78.1AUC
55
VQA-Med Open-Ended 2019
78.65AUC
37
VQA-Med 2019
62.2Accuracy
20
VQA-Med Open-Ended 2019 (test)
78.14AUC
18
VQA-Med (test)
27.96ROUGE-1
17
VQA-Med 2021
0.12Accuracy
16
VQA-Med
73.3Accuracy
9
VQA-Med 2019 n=350 (test)
68.3Accuracy (LLM Judge)
7
VQA-MED
0.493METEOR
4
VQA-MED
76ROUGE-L F1
4
VQA-MED
87.4COMET Score
4
VQA-MED
25.9Sentence BLEU-4
4
VQA-MED
0.891BERTScore
4
VQA-MED
75.8Sentence BLEU-1
4