DataComp
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
DataComp
63.47DataComp Score
28
DataComp small 38 downstream tasks
17.3Mean Score
12
DataComp 38 downstream tasks medium (test)
66.7Accuracy
12
DataComp (test)
57.34DataComp Average
10
DataComp medium Evaluation Suite
37.7Average Score
9
DataComp full (test)
63.47Mean Zero-shot Accuracy
8
Datacomp small (38 tasks)
19.7Average Score
6
DataComp
27.1Jaccard Similarity
6
DataComp Medium scale 128M sample pool
32.3Average Accuracy (38 Datasets)
5
DataComp small 10M (train)
14.6Average Zero-Shot Performance
5
DataComp
31.89Datacomp Average
5
DataComp Evaluation Suite 1.0
39.16DataComp Average
5
DataComp
25.08Average Score
5
Datacomp DFN-1B track
57.34Average Performance (Datacomp)
5
Datacomp DFN-192M track
54.9Average Performance (Datacomp)
5
Datacomp DFN-14M track
39.16Average Performance
5
Datacomp CC12M track
31.89Average Performance
5
Datacomp CC3M track
25.08Average Performance
5
DataComp Small scale 12.8M sample pool
16.5Average Accuracy (Zero-shot)
4
DataComp 15M
74Accuracy
4
DataComp medium-scale (test)
26.8Average Score
3
DataComp medium 100M (train)
25.8Zero-shot Performance
2