VATEX
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
VATEX (HGR)
65.4R@1
7
VATEX HGR partition (test)
78.7R@1
6
VATEX (standard)
83Recall@1
6
VATEX English (test)
36.8Recall@1
6
VATEX Chinese In-domain (test)
29.7BLEU-4
5
VATEX
73.2Accuracy
5
VATEX unseen adverb-action compositions (test)
61.7Accuracy
5
VATEX 42 (val)
80.1R@1
5
VATEX 42 (val)
65.7R@1
5
VATEX English (test)
46.8Recall@1
5
VATEX (test)
32.34BLEU-4
4
VATEX Chinese
33.2BLEU
3
VATEX
40.75Recall@1
3
VATEX public server (test)
96.6CIDEr
3
VATEX (test)
80Avg Recall@K
3
VATEX Chinese
8.4BLEU@4
2
VATEX
81.3R@1
2
VATEX EVAL No Reference
0.232Kendall's Tau
1
VATEX Chinese (test)
—BLEU@4
0
VATEX Chinese out-of-domain (test)
—BLEU@4
0
VATEX public server
—CIDEr
0