Video Summarization on QFVS (Vid 1-4)
84.98F1 (Vid 1)CLIP-It
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| CLIP-ItSupervision=Supervised, Caption Source=Ground Truth2021.07 | 84.98 | 71.26 | 82.55 | 61.46 | 75.06 | |
| CLIP-ItSupervision=Supervised, Caption Source=Generated2021.07 | 74.13 | 63.44 | 75.86 | 50.23 | 65.92 | |
| CLIP-ItSupervision=Unsupervised, Caption Source=Ground Truth2021.07 | 73.9 | 66.83 | 75.44 | 52.31 | 67.12 | |
| CLIP-Image + TransformerSupervision=Supervised2021.07 | 70.8 | 61.67 | 72.43 | 47.48 | 63.11 | |
| CLIP-ItSupervision=Unsupervised, Caption Source=Generated2021.07 | 67.02 | 59.48 | 66.43 | 44.19 | 59.28 | |
| ResNet + TransformerSupervision=Supervised2021.07 | 66.97 | 58.32 | 70.1 | 43.31 | 59.67 | |
| CLIP-Image + TransformerSupervision=Unsupervised2021.07 | 65.44 | 57.21 | 65.1 | 41.63 | 57.35 | |
| CLIP-Image + bi-LSTMSupervision=Supervised2021.07 | 65.43 | 56.55 | 68.63 | 40.06 | 57.67 | |
| QFVSSupervision=Supervised2021.07 | 62.66 | 46.11 | 58.85 | 33.5 | 50.29 | |
| QuasiSupervision=Unsupervised2021.07 | 53.06 | 53.8 | 49.91 | 22.31 | 44.77 | |
| SubModSupervision=Supervised2021.07 | 49.51 | 51.03 | 64.52 | 35.82 | 50.22 |