List your company

ResearchFormerly WizWand

MS-COCO

Benchmarks

TaskDatasetSOTA resultTrendResults

Instance Segmentation

MS COCO novel classes val5k (minival)

18.34AP

26

Object Detection Explanation Faithfulness

MS-COCO

92.6Insertion

25

Multi-label Image Classification

MS-COCO (val)

76.8F1 (C)

25

Image Attribution Detection

MS-COCO Natural

100AUC

24

Image Captioning

MS COCO IR

68.44Score

24

Image Captioning

MS COCO VIS

85.68Score

24

Vision-Language Multi-task Evaluation

MS COCO Unified Multi-task (test)

36.5VQA Score

24

Conditional generation

MS-COCO 512x512 (val)

11.54FID

24

Conditional Image Generation

MS-COCO 512 x 512 1.5

11.54FID

24

Image-Text Retrieval

MS-COCO 1K (test)

84.9Image-to-Text R@1

24

Image Captioning

MS-COCO 1,000 images subset 2014 2017 (val)

0.722SentenceBERT Score

24

Multi-label class-incremental learning

MS-COCO B0-C5

83.1Last mAP

24

Multi-label class-incremental learning

MS-COCO B20-C4

83.1mAP (Last)

24

Image Generation

MS-COCO 10k (test)

21.32FID

24

Generalized Few-Shot Object Detection

MS-COCO

28.1HM

24

Multi-Label Classification

MS-COCO (test)

93.54mAP

24

Panoptic Segmentation

MS-COCO (val)

962PQ

24

Multi-label Image Classification

MS-COCO 2014 (test)

75.3F1 Score (Top-3)

24

Multi-label Image Classification

MS-COCO (test)

83.7mAP

24

Image Captioning

MS-COCO Karpathy 2014 (test)

41.3BLEU-4

24

Object Hallucination Mitigation

MS COCO (500 random samples)

54.4Cs Score

23

Image Reconstruction

MS-COCO 256x256 2017 (val)

32.48PSNR

23

MS-COCO 5K prompts 2014 (val)

27.49FID

23

Gender Classification

MS COCO subset (test)

22FFP

23

Object Detection

MS-COCO 2014 (minival)

38.1mAP

23