List your company

ResearchFormerly WizWand

DataComp

Benchmarks

TaskDatasetSOTA resultTrendResults

Zero-shot Image Classification

DataComp

63.47DataComp Score

28

Classification and Retrieval

DataComp small 38 downstream tasks

17.3Mean Score

12

Image Classification

DataComp 38 downstream tasks medium (test)

66.7Accuracy

12

Zero-shot classification

DataComp (test)

57.34DataComp Average

10

Multi-modal Representation Learning

DataComp medium Evaluation Suite

37.7Average Score

9

Zero-shot Evaluation

DataComp full (test)

63.47Mean Zero-shot Accuracy

8

General Evaluation

Datacomp small (38 tasks)

19.7Average Score

6

Data Membership Prediction

DataComp

27.1Jaccard Similarity

6

Zero-shot Image Classification

DataComp Medium scale 128M sample pool

32.3Average Accuracy (38 Datasets)

5

Zero-shot Image Classification and Retrieval

DataComp small 10M (train)

14.6Average Zero-Shot Performance

5

Multi-modal Evaluation

DataComp

31.89Datacomp Average

5

Multi-modal Classification

DataComp Evaluation Suite 1.0

39.16DataComp Average

5

Image Classification

DataComp

25.08Average Score

5

Datacomp DFN-1B track

57.34Average Performance (Datacomp)

5

Datacomp DFN-192M track

54.9Average Performance (Datacomp)

5

Datacomp DFN-14M track

39.16Average Performance

5

Datacomp CC12M track

31.89Average Performance

5

Datacomp CC3M track

25.08Average Performance

5

Zero-shot Image Classification

DataComp Small scale 12.8M sample pool

16.5Average Accuracy (Zero-shot)

4

Text-to-Image Retrieval

DataComp 15M

74Accuracy

4

Zero-shot classification

DataComp medium-scale (test)

26.8Average Score

3

Zero-shot Image Classification and Retrieval

DataComp medium 100M (train)

25.8Zero-shot Performance

2