Generic Event Boundary Detection on Kinetics-GEBD (val)
78.7F1 Score @ Threshold 0.05SBoCo-TSN
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SBoCo-TSNSupervision=Supervised2024.02 | 78.7 | — | — | — | — | — | — | — | — | — | — | |
| SC-TransformerSupervision=Supervised2024.02 | 77.7 | 84.9 | 87.3 | 88.6 | 89.5 | 90 | 90.4 | 90.7 | 90.9 | 91.1 | 89.2 | |
| DDM-NetSupervision=Supervised2021.12 | 76.4 | 84.3 | 86.6 | 88 | 88.7 | 89.2 | 89.5 | 89.8 | 90 | 90.2 | 87.3 | |
| DDM-NetSupervision=Supervised2024.02 | 76.4 | 84.3 | 86.6 | 88 | 88.7 | 89.2 | 89.5 | 89.8 | 90 | 90.2 | 88.1 | |
| Li et al.Supervision=Supervised2024.02 | 74.3 | 83 | 85.7 | 87.2 | 88 | 88.6 | 89 | 89.3 | 89.6 | 89.8 | 87.3 | |
| Li et al.Hardware=GPU, Params=> 34.6, Latency (ms)=4.72024.02 | 74.3 | — | — | — | — | — | — | — | — | — | — | |
| SBoCo-Res50Supervision=Supervised2024.02 | 73.2 | — | — | — | — | — | — | — | — | — | 86.6 | |
| Ours (Ensembled)Supervision=Unsupervised, Method Type=Non-parametric2024.02 | 71.3 | 82.8 | 85 | 85.8 | 86.2 | 86.4 | 86.6 | 86.7 | 86.8 | 86.9 | 84.5 | |
| FlowGEBD (Ensembled)Hardware=CPU, Params=NA, Latency (ms)=6.52024.02 | 71.3 | — | — | — | — | — | — | — | — | — | — | |
| Gothe et al.Supervision=Supervised2024.02 | 71.2 | — | — | — | — | — | — | — | — | — | — | |
| Gothe et al.Hardware=GPU, Params=6.79, Latency (ms)=1.22024.02 | 71.2 | — | — | — | — | — | — | — | — | — | — | |
| Gothe et al.Hardware=CPU, Params=6.79, Latency (ms)=84.352024.02 | 71.2 | — | — | — | — | — | — | — | — | — | — | |
| UBoCo-Res50Supervision=Unsupervised, Method Type=parametric (neural)2024.02 | 70.3 | 83.9 | 86.2 | 88.5 | 88.9 | 89.3 | 89.4 | 89.8 | 90 | 90.2 | 86.6 | |
| UBoCo-Res50Hardware=GPU, Params=≥ 23.5, Latency (ms)=≥ 46.42024.02 | 70.3 | — | — | — | — | — | — | — | — | — | — | |
| UBoCo-TSNSupervision=Unsupervised, Method Type=parametric (neural)2024.02 | 70.2 | 84.6 | 86.2 | 87.9 | 88.8 | 88.9 | 89.5 | 89.7 | 90.4 | 90.5 | 86.6 | |
| Ours (PT)Supervision=Unsupervised, Method Type=Non-parametric2024.02 | 70.2 | 81.9 | 84.4 | 85.5 | 86 | 86.3 | 86.6 | 86.7 | 86.9 | 87 | 84.1 | |
| UBoCo-TSNHardware=GPU, Params=≥ 90, Latency (ms)=≥ 90.22024.02 | 70.2 | — | — | — | — | — | — | — | — | — | — | |
| FlowGEBD (PT)Hardware=CPU, Params=NA, Latency (ms)=2.262024.02 | 70.2 | — | — | — | — | — | — | — | — | — | — | |
| Ours (FN)Supervision=Unsupervised, Method Type=Non-parametric2024.02 | 69.1 | 82.6 | 86 | 87.7 | 88.5 | 88.9 | 89.2 | 89.4 | 89.6 | 89.7 | 86.1 | |
| FlowGEBD (FN)Hardware=CPU, Params=NA, Latency (ms)=6.422024.02 | 69.1 | — | — | — | — | — | — | — | — | — | — | |
| CoSegSupervision=Unsupervised, Method Type=parametric (neural)2024.02 | 65.6 | 75.8 | 78.3 | 79.4 | 79.9 | 80.3 | 80.4 | 80.6 | 80.7 | 80.9 | 78.2 | |
| CoSegSupervision=Unsupervised, Setting=offline2026.06 | 65.6 | 75.8 | 78.3 | 79.4 | 79.9 | 80.3 | 80.4 | 80.6 | 80.7 | 80.9 | 78.2 | |
| PC + Optical FlowSupervision=Supervised2024.02 | 64.6 | 77.6 | 81.8 | 84.2 | 85.6 | 86.4 | 86.8 | 87.4 | 87.7 | 87.9 | 83 | |
| PCHardware=GPU, Params=23.5, Latency (ms)=46.42024.02 | 63.5 | — | — | — | — | — | — | — | — | — | — | |
| PCSupervision=Supervised2021.12 | 62.5 | 75.8 | 80.4 | 82.9 | 84.4 | 85.3 | 85.9 | 86.4 | 86.7 | 87 | 81.7 | |
| PCSupervision=Supervised2024.02 | 62.5 | 75.8 | 80.4 | 82.9 | 84.4 | 85.3 | 85.9 | 86.4 | 86.7 | 87 | 81.7 | |
| PCSupervision=Supervised, Setting=offline2026.06 | 62.5 | 75.8 | 80.4 | 82.9 | 84.4 | 85.3 | 85.9 | 86.4 | 86.7 | 87 | 81.7 | |
| ESTimatorSupervision=Supervised, Setting=online2026.06 | 62 | 68.7 | 72.4 | 74.6 | 76.2 | 77.4 | 78.2 | 78.9 | 79.5 | 79.9 | 74.8 | |
| Surprise-Gated Robot Episodic MemorySupervision=Unsupervised, Setting=online2026.06 | 61.2 | 74.2 | 80.6 | 84.6 | 86.9 | 88.1 | 88.8 | 89.3 | 89.7 | 90.1 | 83.3 | |
| TCNSupervision=Supervised2021.12 | 58.8 | 65.7 | 67.9 | 69.1 | 69.8 | 70.3 | 70.6 | 70.8 | 71 | 71.2 | 68.5 | |
| TCNSupervision=Supervised, Setting=offline2026.06 | 58.8 | 65.7 | 67.9 | 69.1 | 69.8 | 70.3 | 70.6 | 70.8 | 71 | 71.2 | 68.5 | |
| MiniROAD-BCSupervision=Supervised, Setting=online2026.06 | 56.9 | 62.2 | 64.9 | 67.5 | 69.1 | 70.4 | 71.4 | 72.2 | 72.9 | 73.5 | 68.1 | |
| BMN-StartEndSupervision=Supervised2021.12 | 49.1 | 58.9 | 62.7 | 64.8 | 66 | 66.8 | 67.4 | 67.8 | 68.1 | 68.3 | 64 | |
| BMN-StartEndSupervision=Supervised, Setting=offline2026.06 | 49.1 | 58.9 | 62.7 | 64.8 | 66 | 66.8 | 67.4 | 67.8 | 68.1 | 68.3 | 64 | |
| Oad-TR-BCSupervision=Supervised, Setting=online2026.06 | 47.4 | 51.2 | 53.5 | 55.2 | 56.5 | 57.5 | 58.3 | 59 | 59.6 | 60.1 | 55.8 | |
| TCN-TAPOSSupervision=Supervised2021.12 | 46.4 | 56 | 60.2 | 62.8 | 64.5 | 65.9 | 66.9 | 67.6 | 68.2 | 68.7 | 62.7 | |
| TCN-TAPOSSupervision=Supervised, Setting=offline2026.06 | 46.4 | 56 | 60.2 | 62.8 | 64.5 | 65.9 | 66.9 | 67.6 | 68.2 | 68.7 | 62.7 | |
| Sim-On-BCSupervision=Supervised, Setting=online2026.06 | 46.1 | 53.4 | 57.9 | 61 | 63.3 | 65.1 | 66.4 | 67.5 | 68.5 | 69.2 | 61.8 | |
| TeSTra-BCSupervision=Supervised, Setting=online2026.06 | 43.8 | 48.8 | 52.1 | 54.5 | 56.4 | 58 | 59.3 | 60.4 | 61.4 | 62.2 | 55.7 | |
| PASupervision=Unsupervised2021.12 | 39.6 | 48.8 | 52 | 53.4 | 54.4 | 55 | 55.5 | 55.8 | 56.1 | 56.4 | 52.7 | |
| PASupervision=Unsupervised, Method Type=parametric (neural)2024.02 | 39.6 | 48.8 | 52 | 53.4 | 54.4 | 55 | 55.5 | 55.8 | 56.1 | 56.4 | 52.7 | |
| PAHardware=GPU, Params=23.5, Latency (ms)=46.42024.02 | 39.6 | — | — | — | — | — | — | — | — | — | — | |
| PASupervision=Unsupervised, Setting=offline2026.06 | 39.6 | 48.8 | 52 | 53.4 | 54.4 | 55 | 55.5 | 55.8 | 56.1 | 56.4 | 52.7 | |
| PA - RandomSupervision=Unsupervised2021.12 | 33.6 | 43.5 | 48.4 | 51.2 | 52.9 | 54.1 | 54.8 | 55.4 | 55.8 | 56.1 | 50.6 | |
| PA - RandomSupervision=Unsupervised, Method Type=parametric (neural)2024.02 | 33.6 | 43.5 | 48.4 | 51.2 | 52.9 | 54.1 | 54.8 | 55.4 | 55.8 | 56.1 | 50.6 | |
| PA-RandomSupervision=Unsupervised, Setting=offline2026.06 | 33.6 | 43.5 | 48.4 | 51.2 | 52.9 | 54.1 | 54.8 | 55.4 | 55.8 | 56.1 | 50.6 | |
| SceneDetectSupervision=Unsupervised2021.12 | 27.5 | 30 | 31.2 | 31.9 | 32.4 | 32.7 | 33 | 33.2 | 33.4 | 33.5 | 31.8 | |
| SceneDetectSupervision=Unsupervised, Method Type=Non-parametric2024.02 | 27.5 | 30 | 31.2 | 31.9 | 32.4 | 32.7 | 33 | 33.2 | 33.4 | 33.5 | 31.8 | |
| SceneDetectHardware=CPU, Params=NA, Latency (ms)=34.912024.02 | 27.5 | — | — | — | — | — | — | — | — | — | — | |
| SceneDetectSupervision=Unsupervised, Setting=offline2026.06 | 27.5 | 30 | 31.2 | 31.9 | 32.4 | 32.7 | 33 | 33.2 | 33.4 | 33.5 | 31.8 | |
| BMNSupervision=Supervised2021.12 | 18.6 | 20.4 | 21.3 | 22 | 22.6 | 23 | 23.3 | 23.7 | 23.9 | 24.1 | 22.3 | |
| BMNSupervision=Supervised, Setting=offline2026.06 | 18.6 | 20.4 | 21.3 | 22 | 22.6 | 23 | 23.3 | 23.7 | 23.9 | 24.1 | 22.3 |