VATEX
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
VATEX
95.1R@1
134
VATEX
94.8Recall@1
84
VATEX
99.5CIDEr
76
VATEX (test)
84.2CIDEr
74
VATEX (test)
78.5R@1
69
VATEX Eval
50.8Kendall's Tau-b
60
VATEX (public test)
94.5CIDEr
24
VATEX EVAL (val)
38.1Kendall Tau-b
20
Vatex
28.8Rouge-L
15
VATEX (test)
82.3Recall@1
15
VATEX online evaluation (test)
73CIDEr
15
VATEX (private test)
96.6CIDEr
14
VaTex En-Zh (half of val)
36.43BLEU
12
VATEX V (test)
76.3CIDEr
11
VATEX zero-shot
85.4Recall@1
10
VATEX HGR partition (test)
63.5R@1
9
VATEX-EVAL 9 References
0.368Kendall's Tau Correlation
8
VATEX EVAL 1 Reference
0.286Kendall's Tau
8
Vatex full (test)
45.9R@1
8
VATEX
64.5Recall@1
7
VATEX English
47.8BLEU
7
VATEX
0.817Acc-A
7
VATEX
29mAP W
7
VATEX Adverbs
28.3mAP (W)
7
VATEX Adverbs v1 (test)
16.9mAP W
7