MS-COCO
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MS-COCO 5k image-text pairs
20.044FID
15
MS-COCO 10K (val)
31.959CLIPScore
15
MS COCO 2014 (test)
58.7AP (Box)
15
MS COCO 2017 (val)
8.2AP (Overall)
15
MS-COCO OWOD (Task 4)
45.4mAP (Previously Known)
15
MS-COCO OWOD (Task 2)
67.6mAP (Known)
15
MS-COCO 2018 (test-dev)
53.2PQ (Panoptic Quality)
15
MS COCO 40,775 images (test)
133.5CIDEr
15
MS-COCO random 1,000 prompts 2017 (test)
0.392Textual Faithfulness
14
MS-COCO v1.4 (val)
99.9RickBKD Detection Rate
14
MS COCO 5,000 samples
27.43FID
14
MS-COCO 17
3.01PPL
14
MS-COCO 14
3.01PPL
14
MS COCO 1x (train)
40.5AP
14
MS-COCO Generalized (Novel)
31.5mAP50
14
MS-COCO 30K prompts (val)
3.22FID
14
MS-COCO Canny 2017
20.35FID
13
MS COCO 2014
46.2FID
13
MS-COCO SDXL
23.87FID
13
MS-COCO evaluated after 100-concept erasure
26.56CS
13
MS-COCO evaluated after 50-concept erasure
26.56CLIP Score
13
MS-COCO evaluated after 10-concept erasure
26.56CS Score
13
MS-COCO (test)
40.18FID
13
MS COCO 64x64 zero-shot
6.95Zero-shot FID30k
13
MS-COCO OWOD Task 1
24U-Recall
13