Highlight Detection on TVSum
88.2VTQD-DETR
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| QD-DETRAudio modality=false2023.11 | 88.2 | 87.4 | 85.6 | 85 | 85.8 | 86.9 | 76.4 | 91.3 | 89.2 | 73.7 | 85 | |
| QD-DETRAudio Modality=false2023.11 | 88.2 | 87.4 | 85.6 | 85 | 85.8 | 86.9 | 76.4 | 91.3 | 89.2 | 73.7 | 85 | |
| QD-DETRModality=Visual only2026.05 | 88.2 | 87.4 | 85.6 | 85 | 85.8 | 86.9 | 76.4 | 91.3 | 89.2 | 73.7 | 85 | |
| UVCOMAudio modality=false2023.11 | 87.6 | 91.6 | 91.4 | 86.7 | 86.9 | 86.9 | 76.9 | 92.3 | 87.4 | 75.6 | 86.3 | |
| DiffusionVMR2023.08 | 87.6 | 93.5 | 94.1 | 84.9 | 79.4 | 79.6 | 66.8 | 92.9 | 85.8 | 79.6 | 84.4 | |
| UVCOMModality=Visual only2026.05 | 87.6 | 91.6 | 91.4 | 86.7 | 86.9 | 86.9 | 76.9 | 92.3 | 87.4 | 75.6 | 86.3 | |
| UMTAudio modality=true2023.11 | 87.5 | 81.5 | 88.2 | 78.8 | 81.5 | 87 | 76 | 86.9 | 84.4 | 79.6 | 83.1 | |
| UMTaudio modality=true2023.08 | 87.5 | 81.5 | 88.2 | 78.8 | 81.5 | 87 | 76 | 86.9 | 84.4 | 79.6 | 83.1 | |
| UMTAudio Modality=true2023.11 | 87.5 | 81.5 | 88.2 | 78.8 | 81.4 | 87 | 76 | 86.9 | 84.4 | 79.6 | 83.1 | |
| UMTModality=Audio-Visual2026.05 | 87.5 | 81.5 | 88.2 | 78.8 | 81.5 | 87 | 76 | 86.9 | 84.4 | 79.6 | 83.1 | |
| CG-DETRAudio Modality=false2023.11 | 86.9 | 88.8 | 94.8 | 87.7 | 86.7 | 89.6 | 74.8 | 93.3 | 89.2 | 75.9 | 86.8 | |
| CoSTLModality=Visual only2026.05 | 86.6 | 91.7 | 92.6 | 84.9 | 87.8 | 85.7 | 79.4 | 89.6 | 89.7 | 77.3 | 86.5 | |
| SL-ModuleAudio modality=false2023.11 | 86.5 | 68.7 | 74.9 | 86.2 | 79 | 63.2 | 58.9 | 72.6 | 78.9 | 64 | 73.3 | |
| SL-Module2023.08 | 86.5 | 68.7 | 74.9 | 86.2 | 79 | 63.2 | 58.9 | 72.6 | 78.9 | 84 | 73.3 | |
| SL-ModuleAudio Modality=false2023.11 | 86.5 | 68.7 | 74.9 | 86.2 | 79 | 63.2 | 58.9 | 72.6 | 78.9 | 64 | 73.3 | |
| SL-ModuleModality=Visual only2026.05 | 86.5 | 68.7 | 74.9 | 86.2 | 79 | 63.2 | 58.9 | 72.6 | 78.9 | 64 | 73.3 | |
| TCGAudio modality=true2023.11 | 85 | 71.4 | 81.9 | 78.6 | 80.2 | 75.5 | 71.6 | 77.3 | 78.6 | 68.1 | 76.8 | |
| TCG+2023.08 | 85 | 71.4 | 81.9 | 78.6 | 80.2 | 75.5 | 71.6 | 77.3 | 78.6 | 68.1 | 76.8 | |
| TCGAudio Modality=true2023.11 | 85 | 71.4 | 81.9 | 78.6 | 80.2 | 75.5 | 71.6 | 77.3 | 78.6 | 68.1 | 76.8 | |
| TCGModality=Audio-Visual2026.05 | 85 | 71.4 | 81.9 | 78.6 | 80.2 | 75.5 | 71.6 | 77.3 | 78.6 | 68.1 | 76.8 | |
| R2-tuningModality=Visual only2026.05 | 85 | 85.9 | 91 | 81.7 | 88.8 | 87.4 | 78.1 | 89.27 | 90.3 | 74.7 | 85.2 | |
| UniVTGAudio modality=false2023.11 | 83.9 | 85.1 | 89 | 80.1 | 84.6 | 81.4 | 70.9 | 91.7 | 73.5 | 69.3 | 81 | |
| UniVTG2023.08 | 83.9 | 85.1 | 88 | 80.1 | 84.6 | 81.4 | 70.9 | 91.7 | 73.5 | 69.3 | 81 | |
| UniVTGAudio Modality=false2023.11 | 83.9 | 85.1 | 89 | 80.1 | 84.6 | 81.4 | 70.9 | 91.7 | 73.5 | 69.3 | 81 | |
| UniVTGModality=Visual only2026.05 | 83.9 | 85.1 | 89 | 80.1 | 84.6 | 81.4 | 70.9 | 91.7 | 73.5 | 69.3 | 81 | |
| Joint-VAAudio modality=true2023.11 | 83.7 | 57.3 | 78.5 | 86.1 | 80.1 | 69.2 | 70 | 73 | 97.4 | 67.5 | 76.3 | |
| Joint-VA+2023.08 | 83.7 | 57.3 | 78.5 | 86.1 | 80.1 | 69.2 | 70 | 73 | 97.4 | 67.5 | 76.3 | |
| Joint-VAAudio Modality=true2023.11 | 83.7 | 57.3 | 78.5 | 86.1 | 80.1 | 69.2 | 70 | 73 | 97.4 | 67.5 | 76.3 | |
| Joint-VAModality=Audio-Visual2026.05 | 83.7 | 57.3 | 78.5 | 86.1 | 80.1 | 69.2 | 70 | 73 | 97.4 | 67.5 | 76.3 | |
| MINI-NetAudio modality=true2023.11 | 80.6 | 68.3 | 78.2 | 81.8 | 78.1 | 65.8 | 57.8 | 75 | 80.2 | 65.5 | 73.2 | |
| MINI-Net+2023.08 | 80.6 | 68.3 | 78.2 | 81.9 | 78.1 | 65.8 | 57.8 | 75 | 80.2 | 65.5 | 73.2 | |
| MINI-NetAudio Modality=true2023.11 | 80.6 | 68.3 | 78.2 | 81.8 | 78.1 | 65.8 | 57.8 | 75 | 80.2 | 65.5 | 73.2 | |
| MINI-NetModality=Audio-Visual2026.05 | 80.6 | 68.3 | 78.2 | 81.8 | 78.1 | 65.8 | 57.8 | 75 | 80.2 | 65.5 | 73.2 | |
| TrailerAudio modality=false2023.11 | 61.3 | 54.6 | 65.7 | 60.8 | 59.1 | 70.1 | 58.2 | 64.7 | 65.6 | 68.1 | 62.8 | |
| Trailer2023.08 | 61.3 | 54.6 | 65.7 | 60.8 | 59.1 | 70.1 | 58.2 | 64.7 | 65.6 | 68.1 | 62.8 | |
| TrailerAudio Modality=false2023.11 | 61.3 | 54.6 | 65.7 | 60.8 | 59.1 | 70.1 | 58.2 | 64.7 | 65.6 | 68.1 | 62.8 | |
| TrailerModality=Visual only2026.05 | 61.3 | 54.6 | 65.7 | 60.8 | 59.1 | 70.1 | 58.2 | 64.7 | 65.6 | 68.1 | 62.8 | |
| LIM-SAudio modality=false2023.11 | 55.9 | 42.9 | 61.2 | 54 | 60.4 | 47.5 | 43.2 | 66.3 | 69.1 | 62.6 | 56.3 | |
| LIM-S2023.08 | 55.9 | 42.9 | 61.2 | 54 | 60.4 | 47.5 | 43.2 | 66.3 | 69.1 | 62.6 | 56.3 | |
| LIM-SAudio Modality=false2023.11 | 55.9 | 42.9 | 61.2 | 54 | 60.3 | 47.5 | 43.2 | 66.3 | 69.1 | 62.6 | 56.3 | |
| LIM-SModality=Visual only2026.05 | 55.9 | 42.9 | 61.2 | 54 | 60.4 | 47.5 | 43.2 | 66.3 | 69.1 | 62.6 | 56.3 | |
| SG2023.08 | 42.3 | 47.2 | 47.5 | 48.8 | 45.6 | 47.3 | 46.4 | 41.7 | 48.3 | 46.6 | 46.2 | |
| SGAudio Modality=false2023.11 | 42.3 | 47.2 | 47.5 | 48.9 | 45.6 | 47.3 | 46.4 | 41.7 | 48.3 | 46.6 | 46.2 | |
| sLSTMAudio modality=false2023.11 | 41.1 | 46.2 | 46.3 | 47.7 | 44.8 | 46.1 | 45.2 | 40.6 | 47.1 | 45.5 | 45.1 | |
| sLSTM2023.08 | 41.1 | 46.2 | 46.3 | 47.7 | 44.8 | 46.1 | 45.2 | 40.6 | 47.1 | 45.5 | 45.1 | |
| SLSTMAudio Modality=false2023.11 | 41.1 | 46.2 | 46.3 | 47.7 | 44.8 | 46.1 | 45.2 | 40.6 | 47.1 | 45.5 | 45.1 | |
| sLSTMModality=Visual only2026.05 | 41.1 | 46.2 | 46.3 | 47.7 | 44.8 | 46.1 | 45.2 | 40.6 | 47.1 | 45.5 | 45.1 |