Video-to-Music Retrieval on MusicVid-YT8M track-level (test)
13Median RankMVPt
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MVPtaudio features=DeepSim, visual features=CLIP, temporal model=Transformer, loss=InfoNCE2022.06 | 13 | 6.09 | 24.91 | 41.89 | 42.27 | |
| Baseline + DeepSim + CLIP + Transformers + Temporal embeddingsaudio features=DeepSim, visual features=CLIP, temporal model=Transformer, positional encoding=true2022.06 | 18 | 5.99 | 23.2 | 38.33 | 39.5 | |
| Baseline + DeepSim + CLIP + Transformers w/o positionaudio features=DeepSim, visual features=CLIP, temporal model=Transformer, positional encoding=false2022.06 | 24 | 5.09 | 19.58 | 32.4 | 34.05 | |
| Baseline + DeepSim + CLIP visual featuresaudio features=DeepSim, visual features=CLIP2022.06 | 64 | 3 | 11.13 | 18.56 | 21.33 | |
| Baseline + DeepSim audio featuresaudio features=DeepSim2022.06 | 142 | 1.41 | 5.23 | 9.01 | 11.41 | |
| Baseline2022.06 | 234 | 0.76 | 3.42 | 5.9 | 9.86 | |
| Chance2022.06 | 1,000 | 0.05 | 0.25 | 0.5 | 0.5 |