Text-to-Video Retrieval on MSVD (val)
51.8Recall@1Cap4Video
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Cap4Video2022.12 | 51.8 | 80.8 | 88.3 | 1 | 8.3 | |
| X-Pool2022.12 | 47.2 | 77.4 | 86 | 2 | 9.3 | |
| CLIP4Clip2022.12 | 45.2 | 75.5 | 84.3 | 2 | 10.3 | |
| HowToCaptionVideo-Text Training Data=HowToCaption (ours), Evaluation Protocol=Zero-shot2023.10 | 44.5 | 73.3 | 82.1 | 2 | — | |
| WebVid2MVideo-Text Training Data=WebVid2M [4], Evaluation Protocol=Zero-shot2023.10 | 44.5 | 73.4 | 82.1 | 2 | — | |
| VideoCC3MVideo-Text Training Data=VideoCC3M [39], Evaluation Protocol=Zero-shot2023.10 | 39.6 | 66.7 | 76.8 | 2 | — | |
| HowTo100M (ASRs)Video-Text Training Data=HowTo100M with ASRs [17], Evaluation Protocol=Zero-shot2023.10 | 39.2 | 68.3 | 77.1 | 2 | — | |
| HTM-AAVideo-Text Training Data=HTM-AA (auto-aligned ASRs) [17], Evaluation Protocol=Zero-shot2023.10 | 38.7 | 68.6 | 78.7 | 2 | — | |
| BLIP InitializationVideo-Text Training Data=None (BLIP initialization), Evaluation Protocol=Zero-shot2023.10 | 38.5 | 65 | 74 | 2 | — | |
| HowTo100M (distant supervision)Video-Text Training Data=HowTo100M with distant supervision [31], Evaluation Protocol=Zero-shot2023.10 | 38.5 | 68.6 | 79.4 | 2 | — | |
| CLIP2022.12 | 37 | 64.1 | 73.8 | 3 | — | |
| TMVM2022.12 | 36.7 | 67.4 | 81.3 | 2.5 | — | |
| Frozen2022.12 | 33.7 | 64.7 | 76.3 | 3 | — | |
| SUPPORT2022.12 | 28.4 | 60 | 72.9 | 4 | — | |
| CE2022.12 | 19.8 | 49 | 63.8 | 6 | — |