Text-to-Video Retrieval on SS label v2
73.3R@1UMT-L
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| UMT-L#Pairs=25M2023.03 | 73.3 | 92.7 | — | 96.6 | |
| UMT-L#Pairs=17M2023.03 | 73.1 | 93.2 | — | 96.4 | |
| UMT-L#Pairs=5M2023.03 | 70.5 | 92.3 | — | 95.5 | |
| UMT-B#Pairs=25M2023.03 | 64.2 | 88.2 | — | 92.7 | |
| UMT-B#Pairs=17M2023.03 | 63.4 | 88 | — | 92.9 | |
| UMT-B#Pairs=5M2023.03 | 63.1 | 87.1 | — | 92.3 | |
| HiTeA#Pairs=5M2023.03 | 55.2 | 81.4 | — | 89.1 | |
| VINDLUPretraining Data=25M2022.12 | 53.1 | 81.8 | 84.4 | — | |
| VINDLU#Pairs=25M2023.03 | 53.1 | 81.8 | — | — | |
| VINDLUPretraining Data=17M2022.12 | 53 | 80.8 | 84.6 | — | |
| VINDLUPretraining Data=5M2022.12 | 51.2 | 78.8 | 82.7 | — | |
| SViTTArchitecture=Hybrid, PT=2M, T=8, Protocol=Fine-tuning2023.04 | 49.8 | — | 69.3 | — | |
| SingularityPretraining Data=17M2022.12 | 47.4 | 75.9 | 80 | — | |
| Singularity#Pairs=17M2023.03 | 47.4 | 75.9 | — | — | |
| SingularityPT=5M, T=4, Protocol=Fine-tuning2023.04 | 44.1 | — | 66.6 | — | |
| SViTTArchitecture=Dense, PT=2M, T=8, Protocol=Fine-tuning2023.04 | 43.6 | — | 66.1 | — | |
| CLIP4ClipPretraining Data=400M2022.12 | 43.1 | 71.4 | 77.9 | — | |
| CLIP4ClipPT=400M, T=12, Protocol=Fine-tuning2023.04 | 43.1 | — | 65.1 | — | |
| CLIP4Clip#Pairs=400M2023.03 | 43.1 | 71.4 | — | — | |
| SingularityPT=5M, T=1, Protocol=Fine-tuning2023.04 | 36.4 | — | 58.9 | — | |
| PAXIONPatcher Training Loss=VTC+DVDM2023.05 | 32.3 | 61.2 | — | — | |
| Side-TuningPatcher Training Loss=VTC+DVDM2023.05 | 30.9 | 59.2 | — | — | |
| KP-Perceiver FTPatcher Training Loss=VTC2023.05 | 27 | 57.4 | — | — | |
| Standard SAEModel=VideoMAE, Representation=Standard SAE (6144→512)2026.04 | 25.6 | 43 | — | — | |
| Raster Contr. (R-SAE)Model=VideoMAE, Representation=Raster Contr. (6144→512)2026.04 | 25.1 | 42.2 | — | — | |
| KP-Transformer FTPatcher Training Loss=VTC2023.05 | 24.1 | 50 | — | — | |
| InternVideo Backbone2023.05 | 18.8 | 39.9 | — | — | |
| VideoMAE ReconstructedModel=VideoMAE, Representation=Reconstructed (768→512)2026.04 | 15.2 | 27.6 | — | — | |
| VideoMAE RawModel=VideoMAE, Representation=Raw (768→512)2026.04 | 13.4 | 26.6 | — | — | |
| Temporal Contr. (T-SAE)Model=DINOv2, Representation=Temporal Contr. (6144→512)2026.04 | 13.1 | 28.3 | — | — | |
| Standard SAEModel=DINOv2, Representation=Standard SAE (6144→512)2026.04 | 13 | 27.8 | — | — | |
| DINOv2 ReconstructedModel=DINOv2, Representation=Reconstructed (768→512)2026.04 | 5.4 | 16.6 | — | — | |
| DINOv2 RawModel=DINOv2, Representation=Raw (768→512)2026.04 | 4.6 | 15.2 | — | — |