List your company

ResearchFormerly WizWand

Flickr30k

Benchmarks

TaskDatasetSOTA resultTrendResults

Flickr30k

11.54BLEU-4

14

Weakly Supervised Grounding

Flickr30K (test)

75.6Accuracy (Pointing Game)

14

Image Captioning

Flickr30k

19ASR

13

Multimodal Retrieval

Flickr30k MAG benchmark

91.7R@1

13

Image Captioning

Flickr30k

27.3BLEU-4

13

Text-to-Image Retrieval

Flickr30k-CNA (test)

84.9R@1

13

Image Captioning

Flickr30k

0.78BLEU-1

13

Image-to-Text Retrieval

Flickr30k

92.5Recall@1

12

Vision Language Model Routing

Flickr30k

56.88Utility (OpenAI)

12

Text-to-text retrieval

Flickr30k

60.8mAP

12

Image-to-Text Retrieval

Flickr30K

81.5R@1

12

Text-to-Image Retrieval

Flickr30K-CN 1K (test)

85.9R@1

12

Image-to-Text Retrieval

Flickr30K-CN 1K (test)

96.9R@1

12

Phrase Localization

Flickr30k (test)

69.19Pointing Accuracy

12

Trace Captioning

Flickr30k

20.3CIDEr

11

Image Captioning

Flickr30K zero-shot

82CIDEr

11

Text-to-Image Retrieval

Flickr30k short-caption (test)

47.14Recall@1

10

Image-to-Text Retrieval

Flickr30k short-caption (test)

65.48Recall@1

10

Image Captioning

Flickr30k

17.39BLEU@4

10

Image Captioning

Flickr30k Adversarial, epsilon_a = 4/255

37.1CIDEr

10

Image Captioning

Flickr30k Clean (test)

77.5CIDEr

10

Sentence-to-Image Retrieval

Flickr30k zero-shot generalization from MS-COCO (test)

55.8R@1

10

Image-to-Text Retrieval

Flickr30k-CN (test)

96.9R@1

10

Image-Text Retrieval

Flickr30K 1K (test)

85.6IR@1

10

Multimodal Adaptation

Flickr30k

52.15Flickr30k Performance

9