Cross-modal Retrieval on MSR-VTT (test)
64.9R@5 (V→T)Full Training Dataset
Evaluation Results
| Method | Links | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Full Training DatasetTriplets (Ratio)=Full2026.04 | 64.9 | 37.1 | 36.2 | 24.4 | 22.8 | 9 | 6.1 | 22.6 | 64.7 | 47.6 | 46.3 | 23.6 | 21.6 | 44.8 | — | — | — | |
| HoPATriplets (Ratio)=500 (5.55%), Time (mins)=57.62026.04 | 63.4 | 36.3 | 35.1 | 24.2 | 21.9 | 8.6 | 6.3 | 22.1 | 62 | 45.7 | 44.1 | 21.5 | 20.5 | 42.9 | — | — | — | |
| HoPATriplets (Ratio)=200 (2.22%), Time (mins)=48.22026.04 | 63.2 | 37.3 | 34.8 | 23.4 | 21.5 | 8 | 6.2 | 21.9 | 62.4 | 44.8 | 42.8 | 22.2 | 20.6 | 42.7 | — | — | — | |
| HoPATriplets (Ratio)=100 (1.11%), Time (mins)=42.82026.04 | 62 | 36.2 | 35.6 | 22.6 | 21.3 | 7.9 | 6 | 21.6 | 62.2 | 44.9 | 42.5 | 21.3 | 20.2 | 42.2 | — | — | — | |
| RepBlendTriplets (Ratio)=500 (5.55%), Time (mins)=122.12026.04 | 61.7 | 36.1 | 36.5 | 22.7 | 21.2 | 6.9 | 7.3 | 21.8 | 60.3 | 45.6 | 44.3 | 20.1 | 20.9 | 42.2 | — | — | — | |
| LoRSTriplets (Ratio)=500 (5.55%), Time (mins)=120.42026.04 | 61.5 | 35.9 | 36.6 | 22.6 | 21.2 | 6.9 | 7.3 | 21.8 | 60.6 | 45.4 | 44.5 | 20.4 | 21.9 | 42.4 | — | — | — | |
| RepBlendTriplets (Ratio)=100 (1.11%), Time (mins)=82.02026.04 | 60.7 | 36.2 | 36.7 | 21.7 | 19.8 | 7.4 | 6.6 | 21.4 | 60 | 43.3 | 40.6 | 19.7 | 18.6 | 40.5 | — | — | — | |
| MTT-VLTriplets (Ratio)=500 (5.55%), Time (mins)=118.32026.04 | 60.6 | 34.8 | 36 | 21.9 | 20 | 6.7 | 6.6 | 21 | 59 | 43.9 | 44.8 | 19 | 21 | 41.4 | — | — | — | |
| TESLATriplets (Ratio)=500 (5.55%), Time (mins)=115.72026.04 | 60.3 | 35.1 | 36.3 | 20.1 | 20.2 | 6.8 | 6.4 | 20.8 | 59.8 | 43.5 | 43.2 | 19.7 | 20.1 | 41.1 | — | — | — | |
| LoRSTriplets (Ratio)=100 (1.11%), Time (mins)=77.12026.04 | 60 | 36.1 | 36.6 | 21.8 | 20.5 | 7.8 | 6.8 | 21.6 | 60.4 | 43.3 | 41.7 | 19.8 | 19.6 | 40.8 | — | — | — | |
| RandomTriplets (Ratio)=500 (5.55%)2026.04 | 59.7 | 34.1 | 37.3 | 22.1 | 19.9 | 6.9 | 6.6 | 21.2 | 61.2 | 43.5 | 40.2 | 19 | 17.3 | 40.3 | — | — | — | |
| MTT-VLTriplets (Ratio)=100 (1.11%), Time (mins)=75.72026.04 | 59 | 34.3 | 36.7 | 22.4 | 19.1 | 6.7 | 5.8 | 20.8 | 58.9 | 43.3 | 39.3 | 18.6 | 18.4 | 39.6 | — | — | — | |
| LoRSTriplets (Ratio)=200 (2.22%), Time (mins)=100.92026.04 | 58.9 | 33 | 32.7 | 22.5 | 20.8 | 6 | 7.3 | 20.4 | 59.4 | 45.2 | 45.7 | 19.5 | 21.3 | 41.7 | — | — | — | |
| TESLATriplets (Ratio)=100 (1.11%), Time (mins)=75.42026.04 | 58.8 | 34 | 36.5 | 22.4 | 19.2 | 6.7 | 5.8 | 20.8 | 58.8 | 43.1 | 39.2 | 18.4 | 17.6 | 39.3 | — | — | — | |
| RepBlendTriplets (Ratio)=200 (2.22%), Time (mins)=97.52026.04 | 57.8 | 33.4 | 33.6 | 22.1 | 20.7 | 5.5 | 7.2 | 20.4 | 59.6 | 45.1 | 45.5 | 18.1 | 19.6 | 41 | — | — | — | |
| TESLATriplets (Ratio)=200 (2.22%), Time (mins)=96.42026.04 | 55.9 | 30.7 | 30.5 | 21.6 | 20.2 | 5.8 | 7.4 | 19.4 | 55.3 | 43.6 | 43.7 | 19.5 | 20.8 | 39.8 | — | — | — | |
| MTT-VLTriplets (Ratio)=200 (2.22%), Time (mins)=103.62026.04 | 55.3 | 31.1 | 30.1 | 21 | 20 | 5.8 | 7.4 | 19.2 | 57.4 | 43.7 | 44.7 | 18.9 | 21 | 40.2 | — | — | — | |
| RandomTriplets (Ratio)=200 (2.22%)2026.04 | 54.4 | 29.3 | 37.1 | 22.5 | 20 | 6.9 | 6 | 20.3 | 60.8 | 43.7 | 40 | 18 | 17.3 | 39 | — | — | — | |
| RandomTriplets (Ratio)=100 (1.11%)2026.04 | 54.1 | 29.1 | 37.2 | 22.5 | 19.9 | 6.9 | 6 | 20.3 | 60.7 | 43.8 | 40 | 17.8 | 17.3 | 39 | — | — | — | |
| AVIT-CLIP2026.06 | 36.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | 41.3 | 37 | 48.2 | |
| AVT-CLIP2026.06 | 33.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | 40.4 | — | — | |
| Imagebind-AVIT2026.06 | 33 | — | — | — | — | — | — | — | — | — | — | — | — | — | 35.1 | 32.9 | 36.5 | |
| VideoCLIP2026.06 | 32.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AudioCLIP2026.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 36.9 | — |