MSRVTT
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MSRVTT-QA
72.4Accuracy
513
MSRVTT-QA (test)
88.2Accuracy
376
MSRVTT (test)
46Recall@5
178
MSRVTT
63.9R@1
144
MSRVTT
66.7Accuracy
117
MSRVTT
80.3CIDEr
107
MSRVTT
61R@1
75
MSRVTT (test)
80.7CIDEr
72
MSRVTT
80.3CIDEr
68
MSRVTT 1k (test)
87.4Recall@10
63
MSRVTT-MC
97.7Accuracy
61
MSRVTT
49.9Recall@1
59
MSRVTT
57.7Acc
57
MSRVTT
77.1R@5
45
MSRVTT 1kA severity degree 2
44.2Performance (Gaussian Noise)
42
MSRVTT (1K-A)
49.3R@1
42
MSRVTT (val)
414FVD
40
MSRVTT
51Recall@1
38
MSRVTT (UTD)
31.1Recall@1
34
MSRVTT full (test val)
43.6Recall@1
34
MSRVTT-MC (test)
97.8Accuracy
31
MSRVTT (MSR) zero-shot
43.3R@1
30
MSRVTT
40.4Recall@1
28
MSRVTT v2t 1.0
24.7Performance (Gaussian Noise)
28
MSRVTT (test)
92.7Accuracy
26