nocaps
Benchmarks
TaskDatasetSOTA resultTrendResults
NoCaps
127CIDEr
130
nocaps (val)
126.9CIDEr (Overall)
115
NoCaps (test)
124.8CIDEr
63
nocaps out-of-domain (val)
84.1CLIPScore
40
NoCaps
111.3CIDEr (in-domain)
36
NoCaps 1.0 (val)
127Overall Score
32
NoCaps (val)
99.5Matching Accuracy
26
nocaps standard (test)
124.8CIDEr
26
nocaps RGBP seen scenes (val)
102.67CIDEr
22
nocaps
71.1Win Rate
20
nocaps FOIL (Out-Domain)
89.1AP
17
nocaps-FOIL (Near-Domain)
92.6AP
17
nocaps FOIL In-Domain
88.8AP
17
nocaps-FOIL (Overall)
91.1AP
17
NoCaps
76.2Recall@1
17
NoCaps
90.9R@1
17
NoCaps
1.055CIDEr
16
NoCaps (val)
85.4CIDEr (In-Domain)
16
Nocaps
83.7CIDEr
15
Nocaps
109.37Primary Score
14
nocaps
43.7mAP
12
NoCaps 4,500 (test)
122.1CIDEr
12
Nocaps
105.7Clean CIDEr
10
NoCaps (test)
0.661MPNet Member Score
9
NoCaps
47.7BLEU-4
9