Highlight Detection on TVSum v1.0 (test)
90.8VTLLM-EPET
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| LLM-EPETAudio modality=false2024.07 | 90.8 | 92 | 93.8 | 81.5 | 87.5 | 86 | 79.6 | 96.2 | 88 | 79 | 87.4 | |
| QD-DETR2024.04 | 88.2 | 87.4 | 85.6 | 85 | 85.8 | 86.9 | 76.4 | 91.3 | 89.2 | 73.7 | 85 | |
| TaskWeave2024.04 | 88.2 | 90.8 | 93.3 | 87.5 | 87 | 82 | 80.9 | 92.9 | 89.5 | 81.2 | 87.3 | |
| QD-DETRAudio modality=false2024.07 | 88.2 | 87.4 | 85.6 | 85 | 85.8 | 86.9 | 76.4 | 91.3 | 89.2 | 73.7 | 85 | |
| UMTaudio modality=true2024.04 | 87.5 | 81.5 | 88.2 | 78.8 | 81.4 | 87 | 76 | 86.9 | 84.4 | 79.6 | 83.1 | |
| UMT+Audio modality=true2024.07 | 87.5 | 81.5 | 88.2 | 78.8 | 81.4 | 87 | 76 | 86.9 | 84.4 | 79.6 | 83.1 | |
| SL-Module2024.04 | 86.5 | 68.7 | 74.9 | 86.2 | 79 | 63.2 | 58.9 | 72.6 | 78.9 | 64 | 73.3 | |
| SL-ModuleAudio modality=false2024.07 | 86.5 | 68.7 | 74.9 | 86.2 | 79 | 63.2 | 58.9 | 72.6 | 78.9 | 64 | 73.3 | |
| TCGaudio modality=true2024.04 | 85 | 71.4 | 81.9 | 78.6 | 80.2 | 75.5 | 71.6 | 77.3 | 78.6 | 68.1 | 76.8 | |
| TCG+Audio modality=false2024.07 | 85 | 71.4 | 81.9 | 78.6 | 80.2 | 75.5 | 71.6 | 77.3 | 78.6 | 68.1 | 76.8 | |
| UniVTGpretrain-finetune paradigm=true2024.04 | 83.9 | 85.1 | 89 | 80.1 | 84.6 | 81.4 | 70.9 | 91.7 | 73.5 | 69.3 | 81 | |
| UniVTGAudio modality=false2024.07 | 83.9 | 85.1 | 89 | 80.1 | 84.6 | 81.4 | 70.9 | 91.7 | 73.5 | 69.3 | 81 | |
| Joint-VAaudio modality=true2024.04 | 83.7 | 57.3 | 78.5 | 86.1 | 80.1 | 69.2 | 70 | 73 | 97.4 | 67.5 | 76.3 | |
| Joint-VAAudio modality=true2024.07 | 83.7 | 57.3 | 78.5 | 86.1 | 80.1 | 69.2 | 70 | 73 | 97.4 | 67.5 | 76.3 | |
| MINI-Netaudio modality=true2024.04 | 80.6 | 68.3 | 78.2 | 81.8 | 78.1 | 65.8 | 57.8 | 75 | 80.2 | 65.5 | 73.2 | |
| MINI-NetAudio modality=true2024.07 | 80.6 | 68.3 | 78.2 | 81.8 | 78.1 | 65.8 | 57.8 | 75 | 80.2 | 65.5 | 73.2 | |
| Trailer2024.04 | 61.3 | 54.6 | 65.7 | 60.8 | 59.1 | 70.1 | 58.2 | 64.7 | 65.6 | 68.1 | 62.8 | |
| TrailerAudio modality=false2024.07 | 61.3 | 54.6 | 65.7 | 60.8 | 59.1 | 70.1 | 58.2 | 64.7 | 65.6 | 68.1 | 62.8 | |
| LIM-S2024.04 | 55.9 | 42.9 | 61.2 | 54 | 60.4 | 47.5 | 43.2 | 66.3 | 69.1 | 62.6 | 56.3 | |
| LIM-SAudio modality=false2024.07 | 55.9 | 42.9 | 61.2 | 54 | 60.3 | 47.5 | 43.2 | 66.3 | 69.1 | 62.6 | 56.3 | |
| SG2024.04 | 42.3 | 47.2 | 47.5 | 48.9 | 45.6 | 47.3 | 46.4 | 41.7 | 48.3 | 46.6 | 46.2 | |
| SGAudio modality=false2024.07 | 42.3 | 47.2 | 47.5 | 48.9 | 45.6 | 47.3 | 46.4 | 41.7 | 48.3 | 46.6 | 46.2 | |
| SL-LSTM2024.04 | 41.1 | 46.2 | 46.3 | 47.7 | 44.8 | 46.1 | 45.2 | 40.6 | 47.1 | 45.5 | 45.1 | |
| SLSTMAudio modality=false2024.07 | 41.1 | 46.2 | 46.3 | 47.7 | 44.8 | 46.1 | 45.2 | 40.6 | 47.1 | 45.5 | 45.1 |