Video-to-text retrieval on ActivityNet Captions
72.9R@1VidLA-B/16
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| VidLA-B/16Backbone=CLIP-ViT-B/16, Dual-softmax inference=true2024.03 | 72.9 | 90.6 | 94.9 | — | — | — | 86.1 | |
| VidLA-B/32Backbone=CLIP-ViT-B/32, Dual-softmax inference=true2024.03 | 69.1 | 88.8 | 93.7 | — | — | — | 83.9 | |
| PEAV-LV-Enc Params=0.5B, Video Data=124M, Resolution=336, Frame/ fps=30*, Zero-shot Protocol=true2025.12 | 67.7 | — | — | — | — | — | — | |
| PEAV-LV-Enc Params=0.5B, Video Data=124M, Resolution=336, Frame/ fps=16, Zero-shot Protocol=true2025.12 | 66.5 | — | — | — | — | — | — | |
| PEAV-BV-Enc Params=0.4B, Video Data=124M, Resolution=336, Frame/ fps=30*, Zero-shot Protocol=true2025.12 | 65.9 | — | — | — | — | — | — | |
| PEAV-SV-Enc Params=0.3B, Video Data=124M, Resolution=336, Frame/ fps=30*, Zero-shot Protocol=true2025.12 | 65.5 | — | — | — | — | — | — | |
| PEAV-BV-Enc Params=0.4B, Video Data=124M, Resolution=336, Frame/ fps=16, Zero-shot Protocol=true2025.12 | 64.9 | — | — | — | — | — | — | |
| PEAV-SV-Enc Params=0.3B, Video Data=124M, Resolution=336, Frame/ fps=16, Zero-shot Protocol=true2025.12 | 64.8 | — | — | — | — | — | — | |
| VidLA-B/16Backbone=CLIP-ViT-B/162024.03 | 63.4 | 87.5 | 93.2 | — | — | — | 81.4 | |
| InternVideoBackbone=ViT-L, Dual-softmax inference=true2024.03 | 62.8 | — | — | — | — | — | — | |
| VidLA-B/32Backbone=CLIP-ViT-B/322024.03 | 60.8 | 85 | 91.8 | — | — | — | 79.2 | |
| UMTBackbone=CLIP-ViT-B/16, Two-stage candidate re-ranking=true2024.03 | 56 | 83.5 | 91.7 | — | — | — | 77.1 | |
| InternVideo2V-Enc Params=1.0B, Video Data=102M, Resolution=224, Frame/ fps=8, Zero-shot Protocol=true2025.12 | 54.8 | — | — | — | — | — | — | |
| PE-GV-Enc Params=1.9B, Video Data=22M, Resolution=448, Frame/ fps=8, Zero-shot Protocol=true2025.12 | 51.2 | — | — | — | — | — | — | |
| CAMOEBackbone=CLIP-ViT-B/32, Dual-softmax inference=true2024.03 | 49.9 | 77.4 | — | — | — | — | — | |
| LanguageBindV-Enc Params=0.3B, Video Data=10M, Resolution=224, Frame/ fps=16, Zero-shot Protocol=true2025.12 | 48.8 | — | — | — | — | — | — | |
| DiffusionRetPost-processing=QB-Norm2023.03 | 47.4 | 76.3 | 86.7 | 210.4 | 2 | 6.7 | — | |
| DiffusionRetBackbone=CLIP-ViT-B/32, Dual-softmax inference=true2024.03 | 47.4 | 76.3 | 86.7 | — | — | — | 70.1 | |
| CenterCLIPBackbone=CLIP-ViT-B/162024.03 | 46.7 | 77.1 | 88 | — | — | — | 70.6 | |
| DRLBackbone=CLIP-ViT-B/162024.03 | 45.7 | 76.5 | 87.8 | — | — | — | 70 | |
| CenterCLIPBackbone=CLIP-ViT-B/322024.03 | 44.5 | 75.7 | 86.2 | — | — | — | 68.8 | |
| DiffusionRet2023.03 | 43.8 | 75.3 | 86.7 | 205.8 | 2 | 6.3 | — | |
| EMCL-Net2023.03 | 42.7 | 74 | — | — | 2 | — | — | |
| CLIP4ClipBackbone=CLIP-ViT-B/322024.03 | 42.5 | 74.1 | 85.8 | — | — | — | 67.5 | |
| HBI2023.03 | 42.4 | 73 | 86 | 201.4 | 2 | 6.5 | — | |
| DRLBackbone=CLIP-ViT-B/322024.03 | 42.2 | 74 | 86.2 | — | — | — | 67.5 | |
| PE-LV-Enc Params=0.3B, Video Data=22M, Resolution=336, Frame/ fps=8, Zero-shot Protocol=true2025.12 | 42.1 | — | — | — | — | — | — | |
| CLIP4Clip2023.03 | 41.4 | 73.7 | 85.3 | 200.4 | 2 | 6.7 | — | |
| UMT-LV-Enc Params=0.3B, Video Data=25M, Resolution=224, Frame/ fps=8, Zero-shot Protocol=true2025.12 | 39.4 | — | — | — | — | — | — | |
| ImageBindV-Enc Params=0.6B, Video Data=3M, Resolution=224, Frame/ fps=16, Zero-shot Protocol=true2025.12 | 34.1 | — | — | — | — | — | — | |
| SigLIP2-g-optV-Enc Params=1.1B, Resolution=384, Frame/ fps=8, Zero-shot Protocol=true2025.12 | 33.4 | — | — | — | — | — | — | |
| VideoCoCaprotocol=zero-shot2022.12 | 33 | 61.6 | 75.3 | — | — | — | — | |
| VideoCoCazero-shot=true2022.12 | 33 | 61.6 | 75.3 | — | — | — | — | |
| SigLIP2-L/16V-Enc Params=0.3B, Resolution=384, Frame/ fps=8, Zero-shot Protocol=true2025.12 | 31.5 | — | — | — | — | — | — | |
| InternVideoprotocol=zero-shot2022.12 | 31.4 | — | — | — | — | — | — | |
| InternVideozero-shot=true2022.12 | 31.4 | — | — | — | — | — | — | |
| VideoCoCaprotocol=zero-shot, continued pretraining=false2022.12 | 26.8 | 54.7 | 70 | — | — | — | — | |
| VideoCoCa (w.o. videos)zero-shot=true, initialization=pretrained CoCa model without continued pretraining2022.12 | 26.8 | 54.7 | 70 | — | — | — | — | |
| TT-CE2023.03 | 23 | 56.1 | — | — | 4 | — | — | |
| CoCaprotocol=zero-shot2022.12 | 21.9 | 49.5 | 64.1 | — | — | — | — | |
| CoCazero-shot=true2022.12 | 21.9 | 49.5 | 64.1 | — | — | — | — |