Highlight Detection on YouTube Highlights (test)
76.3mAP (Dog)CG-DETR
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| CG-DETRAudio Modality=false2023.11 | 76.3 | 76.1 | 70 | 76 | 75.1 | 81.9 | 75.9 | |
| PLD-VHD2022.04 | 74.9 | 70.2 | 77.9 | 57.5 | 70.7 | 79 | 73 | |
| UVCOMAudio modality=false, Visual and textual features source=UniVTG2023.11 | 73.8 | 77.1 | 75.7 | 75.3 | 74 | 82.7 | 76.4 | |
| QD-DETRAudio Modality=false2023.11 | 72.2 | 77.4 | 71 | 72.7 | 72.8 | 80.6 | 74.4 | |
| AFM-F-M2022.04 | 72 | 56 | 75 | 68 | 64 | 78 | 68 | |
| UniVTGAudio modality=false2023.11 | 71.8 | 76.5 | 73.9 | 73.3 | 73.2 | 82.2 | 75.2 | |
| UniVTGAudio Modality=false2023.11 | 71.8 | 76.5 | 73.9 | 73.3 | 73.2 | 82.2 | 75.2 | |
| SL-ModuleModality=Visual features only2022.03 | 70.8 | 53.2 | 77.2 | 72.5 | 66.1 | 76.2 | 69.3 | |
| SL2022.04 | 70.8 | 53.2 | 77.2 | 72.5 | 66.1 | 76.2 | 69.3 | |
| SL-ModuleAudio modality=false2023.11 | 70.8 | 53.2 | 77.2 | 72.5 | 66.1 | 76.2 | 69.3 | |
| SL-ModuleAudio Modality=false2023.11 | 70.8 | 53.2 | 77.2 | 72.5 | 66.1 | 76.2 | 69.3 | |
| GNN2022.04 | 67 | 66 | 83 | 70 | 69 | 69 | 69 | |
| UVCOMAudio modality=false, Visual and textual features source=UMT2023.11 | 66.5 | 77.4 | 82.8 | 78.7 | 74.2 | 84.6 | 77.4 | |
| UMTModality=Visual-audio features2022.03 | 65.9 | 75.2 | 81.6 | 71.8 | 72.3 | 82.7 | 74.9 | |
| UMTAudio modality=true2023.11 | 65.9 | 75.2 | 81.6 | 71.8 | 72.3 | 82.7 | 74.9 | |
| UMTAudio Modality=true2023.11 | 65.9 | 75.2 | 81.6 | 71.8 | 72.3 | 82.7 | 74.9 | |
| SA2022.04 | 64.9 | 71.5 | 76.6 | 60.6 | 71.2 | 78.2 | 70.5 | |
| Joint-VAModality=Visual-audio features2022.03 | 64.5 | 71.9 | 80.8 | 62 | 73.2 | 78.3 | 71.8 | |
| Joint-VAAudio modality=true2023.11 | 64.5 | 71.9 | 80.8 | 62 | 73.2 | 78.3 | 71.8 | |
| Joint-VAAudio Modality=true2023.11 | 64.5 | 71.9 | 80.8 | 62 | 73.2 | 78.3 | 71.8 | |
| LSVMModality=Visual features only2022.03 | 60 | 41 | 61 | 62 | 36 | 61 | 53.6 | |
| LSVM2022.04 | 60 | 41 | 61 | 62 | 36 | 61 | 53.6 | |
| LSVMAudio modality=false2023.11 | 60 | 41 | 61 | 62 | 36 | 61 | 53.6 | |
| LSVMAudio Modality=false2023.11 | 60 | 41 | 61 | 62 | 36 | 61 | 53.6 | |
| MINI-NetModality=Visual-audio features2022.03 | 58.2 | 61.7 | 70.2 | 72.2 | 58.7 | 65.1 | 64.4 | |
| MINI-Net2022.04 | 58.2 | 61.7 | 70.2 | 72.2 | 58.7 | 65.1 | 64.4 | |
| MINI-NetAudio modality=true2023.11 | 58.2 | 61.7 | 70.2 | 72.2 | 58.7 | 65.1 | 64.4 | |
| MINI-NetAudio Modality=true2023.11 | 58.2 | 61.7 | 70.2 | 72.2 | 58.7 | 65.1 | 64.4 | |
| LIM-SModality=Visual features only2022.03 | 57.9 | 41.7 | 67 | 57.8 | 48.6 | 65.1 | 56.4 | |
| LIM-s2022.04 | 57.9 | 41.7 | 67 | 57.8 | 48.6 | 65.1 | 56.4 | |
| LIM-SAudio modality=false2023.11 | 57.9 | 41.7 | 67 | 57.8 | 48.6 | 65.1 | 56.4 | |
| LIM-SAudio Modality=false2023.11 | 57.9 | 41.7 | 67 | 57.8 | 48.6 | 65.1 | 56.4 | |
| TCGModality=Visual-audio features2022.03 | 55.4 | 62.7 | 70.9 | 69.1 | 60.1 | 59.8 | 63 | |
| TCGAudio modality=true2023.11 | 55.4 | 62.7 | 70.9 | 69.1 | 60.1 | 59.8 | 63 | |
| TCGAudio Modality=true2023.11 | 55.4 | 62.7 | 70.9 | 69.1 | 60.1 | 59.8 | 63 | |
| RRAEModality=Visual features only2022.03 | 49 | 35 | 50 | 25 | 22 | 49 | 38.3 | |
| RRAE2022.04 | 49 | 35 | 50 | 25 | 22 | 49 | 41.2 | |
| RRAEAudio Modality=false2023.11 | 49 | 35 | 50 | 25 | 22 | 49 | 38.3 | |
| GIFsModality=Visual features only2022.03 | 30.8 | 33.5 | 54 | 55.4 | 32.8 | 54.1 | 46.4 | |
| Video2gif2022.04 | 30.8 | 33.5 | 54 | 55.4 | 32.8 | 54.1 | 46.4 | |
| GIFsAudio modality=false2023.11 | 30.8 | 33.5 | 54 | 55.4 | 32.8 | 54.1 | 46.4 | |
| GIFsAudio Modality=false2023.11 | 30.8 | 33.5 | 54 | 55.4 | 32.8 | 54.1 | 46.4 |