Text-to-Video Retrieval on MSR-VTT 7K
82.8Recall@10TEFAL
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| TEFALBackbone=ViT-B/32, Modality=Audio + Video, Pre-training=WebImageText2023.07 | 82.8 | 48.1 | 73.8 | 2 | 12.1 | |
| CenterCLIPBackbone=ViT-B/16, Algorithm=k-medoids++, Setting=B6 - 4, 160, MeM. (GB)=17.6, Speed (ms)=86.52022.05 | 82.5 | 47.5 | 74.4 | 2 | 13.7 | |
| X-PoolBackbone=ViT-B/32, Pre-training=WebImageText2023.07 | 82.3 | 43.9 | 72.5 | 2 | 14.6 | |
| ECLIPSE_meanPBackbone=ViT-B/32, Modality=Audio + Video, Pre-training=WebImageText2023.07 | 81.9 | 43.2 | 71.5 | 2 | 15.9 | |
| CLIP4clip (meanP)Backbone=ViT-B/16, MeM. (GB)=25.7, Speed (ms)=59.62022.05 | 81.6 | 44.7 | 71.8 | 2 | 14.3 | |
| CLIP4clip (meanP)MeM. (GB)=20.8, Speed (ms)=24.42022.05 | 81.4 | 42.1 | 71.9 | 2 | 15.7 | |
| CLIP4Clip_meanPBackbone=ViT-B/32, Pre-training=WebImageText2023.07 | 81.4 | 42.1 | 71.9 | 2 | 16.2 | |
| CenterCLIPBackbone=ViT-B/32, Algorithm=k-medoids++, Setting=B6 - 4, 49, MeM. (GB)=15, Speed (ms)=22.92022.05 | 80.8 | 43.7 | 71.3 | 2 | 16.9 | |
| CenterCLIPBackbone=ViT-B/32, Pre-training=WebImageText2023.07 | 80.8 | 43.7 | 71.3 | 2 | 16.9 | |
| CenterCLIPBackbone=ViT-B/32, Algorithm=spectral, Setting=B6 - 3, 49, MeM. (GB)=14.2, Speed (ms)=43.62022.05 | 80.2 | 43.7 | 71.3 | 2 | 16.2 | |
| CenterCLIPBackbone=ViT-B/32, Algorithm=spectral, Setting=B6 - 4, 49, MeM. (GB)=14.9, Speed (ms)=40.82022.05 | 79.8 | 43.4 | 70.5 | 2 | 15.7 | |
| CenterCLIPBackbone=ViT-B/32, Algorithm=k-medoids++, Setting=B6 - 3, 49, MeM. (GB)=14.2, Speed (ms)=22.92022.05 | 79.7 | 43.5 | 68.5 | 2 | 17.7 | |
| CLIP4clip (meanP)Backbone=ViT-B/32, MeM. (GB)=20.8, Speed (ms)=24.42022.05 | 79.4 | 42.4 | 69.2 | 2 | 17.3 | |
| CLIP4clip (seqTransf)2022.05 | 78.7 | 42 | 68.6 | 2 | 16.2 | |
| Everything at onceBackbone=ViT-B/32, Modality=Audio + Video, Pre-training=WebImageText2023.07 | 75 | — | 62.7 | — | — | |
| ALPROBackbone=ViT-B/32, Pre-training=WebImageText + 5.5M additional pairs2023.07 | 73.2 | 33.9 | 60.7 | 3 | — | |
| COTS# PT Pairs=15.3M, extra_modalities=false2022.04 | 70.2 | 32.1 | 60.8 | — | 3 | |
| COTS# PT Pairs=5.3M, extra_modalities=false2022.04 | 67.7 | 29 | 57 | — | 3 | |
| TACO# PT Pairs=>100M, extra_modalities=true2022.04 | 64.5 | 24.8 | 52.1 | — | 5 | |
| UniVL# PT Pairs=>100M, extra_modalities=true2022.04 | 63.1 | 21.2 | 49.6 | — | 6 | |
| ClipBERT# PT Pairs=5.6M, extra_modalities=false2022.04 | 59.9 | 22 | 46.8 | — | 6 | |
| HERO# PT Pairs=>100M, extra_modalities=false2022.04 | 57.7 | 16.8 | 43.4 | — | — | |
| ActBERT# PT Pairs=>100M, extra_modalities=false2022.04 | 56.9 | 16.3 | 42.8 | — | 10 | |
| NoiseEstimation# PT Pairs=>100M, extra_modalities=true2022.04 | 53.6 | 17.4 | 41.6 | — | 8 | |
| HT MIL-NCE# PT Pairs=>100M, extra_modalities=false2022.04 | 52.8 | 14.9 | 40.2 | — | 9 | |
| VidTranslate# PT Pairs=>100M, extra_modalities=false2022.04 | 52.8 | 14.7 | — | — | — | |
| JSFusionextra_modalities=false2022.04 | 43.2 | 10.2 | 31.2 | — | 13 |