Highlight Detection on YouTube Highlights (full)
74.1mAP (Dog)DiffusionVMR
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| DiffusionVMR2023.08 | 74.1 | 78.7 | 74.2 | 73.8 | 73.9 | 80.8 | 75.9 | |
| LLM-EPETaudio modality=false2024.07 | 73.6 | 73.2 | 72.5 | 75.3 | 73.4 | 82.5 | 75.3 | |
| QD-DETR2023.08 | 72.2 | 77.4 | 71 | 72.7 | 72.8 | 80.6 | 74.4 | |
| QD-DETRaudio modality=false2024.07 | 72.2 | 77.4 | 71 | 72.7 | 72.8 | 80.6 | 74.4 | |
| UniVTG2023.08 | 71.8 | 76.5 | 73.9 | 73.3 | 73.2 | 82.2 | 75.2 | |
| UniVTGaudio modality=false2024.07 | 71.8 | 76.5 | 73.9 | 73.3 | 73.2 | 82.2 | 75.2 | |
| SL-Module2023.08 | 70.8 | 53.2 | 77.2 | 72.5 | 66.1 | 76.2 | 69.3 | |
| SL-Moduleaudio modality=false2024.07 | 70.8 | 53.2 | 77.2 | 72.5 | 66.1 | 76.2 | 69.3 | |
| UMTaudio modality=true2023.08 | 65.9 | 75.2 | 81.6 | 71.8 | 72.3 | 82.7 | 74.9 | |
| UMT +audio modality=false2024.07 | 65.9 | 75.2 | 81.6 | 71.8 | 72.3 | 82.7 | 74.9 | |
| Joint-VAaudio modality=true2023.08 | 64.5 | 71.9 | 80.8 | 62 | 73.2 | 78.3 | 71.8 | |
| Joint-VAaudio modality=true2024.07 | 64.5 | 71.9 | 80.8 | 62 | 73.2 | 78.3 | 71.8 | |
| LSVM2023.08 | 60 | 41 | 61 | 62 | 36 | 61 | 53.6 | |
| LSVMaudio modality=false2024.07 | 60 | 41 | 61 | 62 | 36 | 61 | 53.6 | |
| MINI-Netaudio modality=true2023.08 | 58.2 | 61.7 | 70.2 | 72.2 | 58.7 | 65.1 | 64.4 | |
| MINI-Netaudio modality=true2024.07 | 58.2 | 61.7 | 70.2 | 72.2 | 58.7 | 65.1 | 64.4 | |
| LIM-S2023.08 | 57.9 | 41.7 | 67 | 57.8 | 48.6 | 65.1 | 56.4 | |
| LIM-Saudio modality=false2024.07 | 57.9 | 41.7 | 67 | 57.8 | 48.6 | 65.1 | 56.4 | |
| TCGaudio modality=true2023.08 | 55.4 | 62.7 | 70.9 | 69.1 | 60.1 | 59.8 | 63 | |
| TCG +audio modality=false2024.07 | 55.4 | 62.7 | 70.9 | 69.1 | 60.1 | 59.8 | 63 | |
| RRAE2023.08 | 49 | 35 | 50 | 25 | 22 | 49 | 38.3 | |
| RRAEaudio modality=false2024.07 | 49 | 35 | 50 | 25 | 22 | 49 | 38.3 | |
| GIFs2023.08 | 30.8 | 33.5 | 54 | 55.4 | 32.8 | 54.1 | 46.4 | |
| GIFsaudio modality=false2024.07 | 30.8 | 33.5 | 54 | 55.4 | 32.8 | 54.1 | 46.4 |