ShareGPT4V
Benchmarks
TaskDatasetSOTA resultTrendResults
ShareGPT4V
97.9R@1
52
ShareGPT4V
97.8Recall@1
34
ShareGPT4V 1k
99Recall@1
11
ShareGPT4V 1k
99.5R@1
11
ShareGPT4V (unseen)
95.8R@1
9
ShareGPT4V (unseen)
96.6R@1
9
ShareGPT4V 10k
94.8Recall@1
9
ShareGPT4V 10k
95.5R@1
9
ShareGPT4V (val)
98.5R@1
8
ShareGPT4V (val)
98.7R@1
8
ShareGPT4V 5,000 samples (test)
88.62R@1
6
ShareGPT4V 5,000 samples (test)
85.48R@1
6
ShareGPT4V
95.4Retrieval Score (Word Dropout p=0.3)
4
ShareGPT4V
90.8Recall@1
4
ShareGPT4V
0.939Recall@1
4
ShareGPT4V
47.9BLEU-1
3
ShareGPT4V
46.8CHAIR-S Score
3
ShareGPT4V (val)
0.317FID
2