Multimodal Retrieval on VGGSound-S (test)
6.8Recall@1 (Video -> Text)Full Dataset
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Full DatasetTriplets (Ratio)=Full2026.04 | 6.8 | 8.6 | 28 | 26.6 | 7.5 | 4.8 | 13.7 | 30.8 | 34.6 | 55.7 | 54 | 26.8 | 24.5 | 37.7 | |
| HoPATriplets (Ratio)=200 (2.5%), Time (mins)=50.42026.04 | 6.7 | 8.5 | 27 | 26.1 | 6.9 | 4.9 | 13.4 | 28.6 | 30.9 | 54.8 | 53.2 | 23.7 | 23.1 | 35.7 | |
| HoPATriplets (Ratio)=100 (1.25%), Time (mins)=45.72026.04 | 6.6 | 8.3 | 27.3 | 26.1 | 6.6 | 4.6 | 13.3 | 28.6 | 30.3 | 54 | 53.2 | 23.2 | 22.2 | 35.3 | |
| HoPATriplets (Ratio)=500 (6.25%), Time (mins)=55.12026.04 | 6.6 | 8.6 | 27.1 | 26 | 6.9 | 5.3 | 13.4 | 29.2 | 32.3 | 55 | 53.6 | 24.8 | 23.5 | 36.4 | |
| LoRSTriplets (Ratio)=200 (2.5%), Time (mins)=85.52026.04 | 6.4 | 8.2 | 26.7 | 25.6 | 6.9 | 5.1 | 13.2 | 27.5 | 28.9 | 53.4 | 53.2 | 24.6 | 22.7 | 35.1 | |
| LoRSTriplets (Ratio)=500 (6.25%), Time (mins)=124.82026.04 | 6.4 | 8.4 | 27 | 25.9 | 7.2 | 5.1 | 13.3 | 27.8 | 30.7 | 53.7 | 53.5 | 24.9 | 22.8 | 35.6 | |
| RepBlendTriplets (Ratio)=500 (6.25%), Time (mins)=125.52026.04 | 6.4 | 8.4 | 27 | 25.9 | 7.1 | 5.3 | 13.3 | 28.3 | 30.8 | 54.3 | 53.6 | 25 | 23 | 35.8 | |
| RepBlendTriplets (Ratio)=200 (2.5%), Time (mins)=87.22026.04 | 6.3 | 8.1 | 26.9 | 25.7 | 7.1 | 5.2 | 13.2 | 28.1 | 29.4 | 54.1 | 53.2 | 24.8 | 22.9 | 35.4 | |
| MTT-VLTriplets (Ratio)=100 (1.25%), Time (mins)=80.92026.04 | 6.2 | 7.6 | 26.1 | 25.8 | 5.9 | 4.3 | 12.7 | 26.1 | 27.5 | 53.7 | 52.5 | 20.4 | 18.8 | 33.2 | |
| RandomTriplets (Ratio)=500 (6.25%)2026.04 | 6.1 | 7.9 | 26.7 | 25.8 | 6.1 | 4.1 | 12.8 | 27.2 | 28.8 | 54.5 | 52.3 | 21.1 | 19.4 | 33.9 | |
| TESLATriplets (Ratio)=500 (6.25%), Time (mins)=124.32026.04 | 6.1 | 7.9 | 26 | 26 | 6.4 | 4.6 | 12.8 | 27.1 | 28 | 52.8 | 53 | 22.9 | 21.2 | 34.2 | |
| RandomTriplets (Ratio)=200 (2.5%)2026.04 | 6 | 7.7 | 26.6 | 25.6 | 5.8 | 4 | 12.6 | 25.5 | 27.9 | 54.4 | 52 | 20.6 | 19 | 33.2 | |
| TESLATriplets (Ratio)=200 (2.5%), Time (mins)=85.82026.04 | 6 | 7.6 | 25.8 | 25.7 | 5.7 | 4.2 | 12.5 | 26.1 | 27.4 | 52.5 | 52.7 | 20.3 | 19 | 33 | |
| TESLATriplets (Ratio)=100 (1.25%), Time (mins)=81.52026.04 | 5.9 | 7.6 | 26.1 | 25.8 | 6.2 | 3.8 | 12.6 | 25.6 | 27.4 | 53.8 | 52.6 | 22 | 20.5 | 33.7 | |
| MTT-VLTriplets (Ratio)=500 (6.25%), Time (mins)=123.72026.04 | 5.9 | 8.2 | 26.9 | 25.8 | 6.7 | 4.9 | 13 | 27 | 29.5 | 53 | 53.5 | 24 | 23 | 35 | |
| MTT-VLTriplets (Ratio)=200 (2.5%), Time (mins)=86.32026.04 | 5.8 | 8.1 | 26.8 | 25.4 | 6.6 | 4.8 | 12.9 | 26.8 | 29.2 | 52.7 | 53.3 | 23.8 | 22.8 | 34.8 | |
| RandomTriplets (Ratio)=100 (1.25%)2026.04 | 5.7 | 7.7 | 26.3 | 25.7 | 5.6 | 3.7 | 12.4 | 25.9 | 28.3 | 54.3 | 52.1 | 20.5 | 18.6 | 33.3 | |
| RepBlendTriplets (Ratio)=100 (1.25%), Time (mins)=81.92026.04 | 5.6 | 7.6 | 27.2 | 25 | 6.1 | 4.5 | 12.7 | 27.1 | 28.6 | 54.1 | 51.4 | 20.9 | 19.9 | 33.7 | |
| LoRSTriplets (Ratio)=100 (1.25%), Time (mins)=84.92026.04 | 5.4 | 7.8 | 27.8 | 26.2 | 6.3 | 4.5 | 13 | 26.5 | 28.2 | 53.1 | 52.2 | 22.3 | 21.6 | 34 |