Flickr30k
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Flickr30k
11.54BLEU-4
14
Flickr30K (test)
75.6Accuracy (Pointing Game)
14
Flickr30k
19ASR
13
Flickr30k MAG benchmark
91.7R@1
13
Flickr30k
27.3BLEU-4
13
Flickr30k-CNA (test)
84.9R@1
13
Flickr30k
0.78BLEU-1
13
Flickr30k
92.5Recall@1
12
Flickr30k
56.88Utility (OpenAI)
12
Flickr30k
60.8mAP
12
Flickr30K
81.5R@1
12
Flickr30K-CN 1K (test)
85.9R@1
12
Flickr30K-CN 1K (test)
96.9R@1
12
Flickr30k (test)
69.19Pointing Accuracy
12
Flickr30k
20.3CIDEr
11
Flickr30K zero-shot
82CIDEr
11
Flickr30k short-caption (test)
47.14Recall@1
10
Flickr30k short-caption (test)
65.48Recall@1
10
Flickr30k
17.39BLEU@4
10
Flickr30k Adversarial, epsilon_a = 4/255
37.1CIDEr
10
Flickr30k Clean (test)
77.5CIDEr
10
Flickr30k zero-shot generalization from MS-COCO (test)
55.8R@1
10
Flickr30k-CN (test)
96.9R@1
10
Flickr30K 1K (test)
85.6IR@1
10
Flickr30k
52.15Flickr30k Performance
9