MSCOCO
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MSCOCO
81.9IR@1
27
MSCOCO
31.4BLEU@4
27
MSCOCO Popular
89.2Accuracy
27
MSCOCO 1k
0.94ΔCIDEr
27
MSCOCO CHAIR
52.4CHAIR_S
27
MSCOCO 2014 (val)
32.4CHAIR Specificity Score
27
MSCOCO
57.2BLEU-1
26
MSCOCO
57.4CHAIRs
26
MSCOCO Caption
59.9R@1
26
MSCOCO Caption
77R@1
26
MSCOCO (500 random samples)
53Cs
25
MSCOCO (test)
84.6R@5
25
MSCOCO POPE (random popular adversarial)
86.79Accuracy
24
MSCOCO @5000 (seen classes)
85.2Seen@Seen mAP
24
MSCOCO @5000 15%-unseen
58.4mAP (Unseen@Unseen)
24
MSCOCO En-De
36.2BLEU
23
MSCOCO 10k (val)
13.14FID
22
MSCOCO zero-shot 30k
5.76FID (MSCOCO 30k, zero-shot)
22
MSCOCO POPE (Popular)
93.87Accuracy
22
MSCOCO (test server)
40.3BLEU-4 (c5)
22
MSCOCO
53.4Recall@1
21
MSCOCO
55.2CS Score
21
MSCOCO (random sampling of 500 instances)
26.72CHAIRs
21
MSCOCO (test)
79.52Accuracy
21
MSCOCO En-Fr
53.2BLEU
21