Temporal Action Detection on ActivityNet v1.3 (val)
61.72mAP@0.5AdaTAD
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| AdaTADBackbone=VideoMAEv2-g, E2E=true, Flow=false, Mem=50.6, Resolution=1536x224^2, Note=Last half of backbone layers adapted2023.11 | 61.72 | 43.35 | 10.85 | 41.93 | |
| AdaTAD†Backbone=VideoMAEv2-g, E2E=true, Flow=false, Mem=43.6, Resolution=1536x224^22023.11 | 60.82 | 42.69 | 9.84 | 41.15 | |
| AdaTADBackbone=VideoMAEv2-g, E2E=true, Flow=false, Mem=29.92023.11 | 58.45 | 41.16 | 10.45 | 39.79 | |
| AdaTADBackbone=VideoMAE-H, E2E=true, Flow=false, Mem=19.22023.11 | 58.04 | 40.55 | 9.75 | 39.37 | |
| AdaTADBackbone=VideoMAE-L, E2E=true, Flow=false, Mem=11.02023.11 | 57.69 | 40.56 | 10.13 | 39.22 | |
| ADI-DiffFeature=R(2+1)D2024.04 | 56.9 | 38.9 | 9.1 | 38.3 | |
| AdaTADBackbone=VideoMAE-B, E2E=true, Flow=false, Mem=4.92023.11 | 56.77 | 39.35 | 9.71 | 38.39 | |
| TAGSFeature=I3D2024.04 | 56.3 | 36.8 | 9.6 | 36.5 | |
| AdaTADBackbone=VideoMAE-S, E2E=true, Flow=false, Mem=2.52023.11 | 56.15 | 38.99 | 9.07 | 37.85 | |
| DiffTADFeature=I3D2024.04 | 56.1 | 36.9 | 9 | 36.1 | |
| ContextLocFeature=I3D2024.04 | 56 | 35.2 | 3.6 | 34.2 | |
| AdaTADBackbone=SlowFast-R50, E2E=true, Flow=false, Mem=4.32023.11 | 55.28 | 38.11 | 8.87 | 37.11 | |
| Re2TALBackbone=Re2 VideoSwin-T, E2E=true, Flow=false, Mem=242023.11 | 54.75 | 37.81 | 9.03 | 36.8 | |
| ActionFormerFeature=R(2+1)D2024.04 | 54.7 | 37.8 | 8.4 | 36.6 | |
| TriDetFeature=R(2+1)D2024.04 | 54.7 | 38 | 8.4 | 36.8 | |
| TriDetBackbone=I3D, E2E=false, Flow=true2023.11 | 54.7 | 38 | 8.4 | 36.8 | |
| AOE-NetFeature=C3D2022.10 | 54.42 | 35.43 | 10.35 | 35.48 | |
| TCANetProposal Source=BMN, Feature=SlowFast2021.03 | 54.33 | 39.13 | 8.41 | 37.56 | |
| ActionFormerBackbone=SlowFast-R50, E2E=false, Flow=true2023.11 | 54.26 | 37.04 | 8.13 | 36.02 | |
| ASLBackbone=I3D, E2E=false, Flow=true2023.11 | 54.1 | 37.4 | 8 | 36.2 | |
| TALLFormerBackbone=VideoSwin-B, E2E=true, Flow=false, Mem=292023.11 | 54.1 | 36.2 | 7.9 | 35.6 | |
| PBRNetFeature=I3D2024.04 | 54 | 35 | 9 | 35 | |
| ActionFormerBackbone=I3D, E2E=false, Flow=true2023.11 | 53.5 | 36.2 | 8.2 | 35.6 | |
| VSGNFeature=R(2+1)D2024.04 | 53.3 | 36.8 | 8.1 | 35.9 | |
| GTANVenue & Year=CVPR19, Feature=P3D2022.10 | 52.61 | 34.14 | 8.91 | 34.31 | |
| GTANVideo-level classification=[43], Post-processing=NMS2021.10 | 52.6 | 34.1 | 8.9 | 34.3 | |
| GTANFeature=P3D2024.04 | 52.6 | 34.1 | 8.9 | 34.3 | |
| AEI-GArchitecture=GCN-based BMM, Video-level classification=[43], Post-processing=NMS2021.10 | 52.4 | 34.5 | 9.6 | 34.7 | |
| AFSDType=Anchor-based, FLOPs(G)=15.32022.07 | 52.4 | 35.2 | 6.5 | 34.3 | |
| AFSDBackbone=I3D, RGB-Only=false2022.05 | 52.4 | 35.3 | 6.5 | 34.4 | |
| BMN-CSAFeature=TSN2024.04 | 52.4 | 36.2 | 5.2 | 35.4 | |
| AFSDFeature=I3D2024.04 | 52.4 | 35.3 | 6.5 | 34.4 | |
| AFSDBackbone=I3D, E2E=true, Flow=true, Mem=122023.11 | 52.4 | 35.3 | 6.5 | 34.4 | |
| AEI-BArchitecture=CNN-based BMM, Video-level classification=[43], Post-processing=NMS2021.10 | 52.3 | 34.5 | 9.7 | 34.7 | |
| VSGNType=Actioness2022.07 | 52.3 | 35.2 | 8.3 | 34.7 | |
| TCANetType=Anchor-based2022.07 | 52.3 | 36.7 | 6.9 | 35.5 | |
| AEI-BVenue & Year=BMVC21, Feature=C3D2022.10 | 52.3 | 34.5 | 9.7 | 34.7 | |
| TCANetFeature=TSN2024.04 | 52.3 | 36.7 | 6.9 | 35.5 | |
| TCANetProposal Source=BMN, Feature=2stream2021.03 | 52.27 | 36.73 | 6.86 | 35.52 | |
| BMNFeature=SlowFast2021.03 | 52.24 | 35.89 | 8.33 | 35.28 | |
| Self-DETRFeature=I3D2024.04 | 52.2 | 33.6 | 8.4 | 33.7 | |
| TCANetProposal Source=BSN, Feature=2stream2021.03 | 51.91 | 34.92 | 7.46 | 34.43 | |
| ABNVideo-level classification=[43], Post-processing=NMS2021.10 | 51.8 | 34.2 | 10.3 | 34.2 | |
| DCANVideo-level classification results=Zhao et al. 2017b2021.12 | 51.78 | 35.98 | 9.45 | 35.39 | |
| ABNVenue & Year=IEEE-Access21, Feature=C3D2022.10 | 51.78 | 34.18 | 10.29 | 34.22 | |
| STPTFeature=STPT2024.04 | 51.4 | 33.7 | 6.8 | 33.4 | |
| BSN++Video-level classifier=Xiong et al. 20162020.09 | 51.27 | 35.7 | 8.33 | 34.88 | |
| BSN++Feature=2stream2021.03 | 51.27 | 35.7 | 8.33 | 34.88 | |
| BSN++Video-level classification results=Zhao et al. 2017b2021.12 | 51.27 | 35.7 | 8.33 | 34.88 | |
| TSI++Video-level classification=[43], Post-processing=NMS2021.10 | 51.2 | 35 | 6.6 | 34.2 | |
| PlusTAD (Anchor-free)Backbone=R50-SlowOnly, RGB-Only=true, Resolution=224, Input Frames=962022.05 | 51.2 | 33.41 | 7.57 | 33.12 | |
| BasicTADBackbone=SlowOnly-R50, E2E=true, Flow=false, Mem=122023.11 | 51.2 | 33.41 | 7.57 | 33.12 | |
| TSI++Venue & Year=ACCV20, Feature=2Stream2022.10 | 51.18 | 35 | 6.59 | 34.15 | |
| SSTAPLabel Percentage=100%, Classifier=[55]2021.04 | 50.72 | 35.28 | 7.87 | 34.48 | |
| SSTAPLabel Percentage=90%, Classifier=[55]2021.04 | 50.64 | 35.12 | 7.8 | 34.35 | |
| BC-GNNFeature=TSN2024.04 | 50.6 | 34.8 | 9.4 | 34.3 | |
| BC-GNNReference=ECCV'20, Classifier=[55]2021.04 | 50.56 | 34.75 | 9.37 | 34.26 | |
| BC-GNNVideo-level classification results=Zhao et al. 2017b2021.12 | 50.56 | 34.75 | 9.37 | 34.26 | |
| BC-GNNVenue & Year=ECCV20, Feature=2Stream2022.10 | 50.56 | 34.75 | 9.37 | 34.26 | |
| BC-GNNclassifier=[33]2020.08 | 50.56 | 34.75 | 9.37 | 34.26 | |
| Ji et al.Label Percentage=100%, Reference=ICCV'19, Classifier=[55]2021.04 | 50.55 | 35.01 | 7.58 | 34.23 | |
| E2E-TADBackbone=SlowFast-R50, E2E=true, Flow=false, Mem=122023.11 | 50.47 | 35.99 | 10.33 | 35.1 | |
| GTADVideo-level classification=[43], Post-processing=NMS2021.10 | 50.4 | 34.6 | 9 | 34.1 | |
| G-TADType=Actioness, FLOPs(G)=45.72022.07 | 50.4 | 34.6 | 9 | 34.1 | |
| G-TADFeature=TSN2024.04 | 50.4 | 34.6 | 9 | 34.1 | |
| G-TAD2019.11 | 50.36 | 34.6 | 9.02 | 34.09 | |
| G-TADVideo-level classifier=Xiong et al. 20162020.09 | 50.36 | 34.6 | 9.02 | 34.09 | |
| G-TADFeature=2stream2021.03 | 50.36 | 34.6 | 9.02 | 34.09 | |
| G-TADReference=CVPR'20, Classifier=[55]2021.04 | 50.36 | 34.6 | 9.02 | 34.09 | |
| G-TADVideo-level classification results=Zhao et al. 2017b2021.12 | 50.36 | 34.6 | 9.02 | 34.09 | |
| GTADVenue & Year=CVPR20, Feature=2Stream2022.10 | 50.36 | 34.6 | 9.02 | 34.09 | |
| G-TADBackbone=TSN, RGB-Only=false2022.05 | 50.36 | 34.6 | 9.02 | 34.09 | |
| Ji et al.Label Percentage=90%, Reference=ICCV'19, Classifier=[55]2021.04 | 50.24 | 34.97 | 7.35 | 34.13 | |
| SSTAPLabel Percentage=60%, Classifier=[55]2021.04 | 50.14 | 34.92 | 7.43 | 34.01 | |
| BMNVideo-level classification=[43], Post-processing=NMS2021.10 | 50.1 | 34.8 | 8.3 | 33.9 | |
| BMNType=Actioness, FLOPs(G)=45.62022.07 | 50.1 | 34.8 | 8.3 | 33.9 | |
| BMNFeature=TSN2024.04 | 50.1 | 34.8 | 8.3 | 33.9 | |
| BMNclassifier=[36]2019.07 | 50.07 | 34.78 | 8.29 | 33.85 | |
| BMN2019.11 | 50.07 | 34.78 | 8.29 | 33.85 | |
| BMNVideo-level classifier=Xiong et al. 20162020.09 | 50.07 | 34.78 | 8.29 | 33.85 | |
| BMNFeature=2stream2021.03 | 50.07 | 34.78 | 8.29 | 33.85 | |
| BMNLabel Percentage=100%, Reference=ICCV'19, Classifier=[55]2021.04 | 50.07 | 34.78 | 8.29 | 33.85 | |
| BMNVideo-level classification results=Zhao et al. 2017b2021.12 | 50.07 | 34.78 | 8.29 | 33.85 | |
| BMNVenue & Year=ICCV19, Feature=2Stream2022.10 | 50.07 | 34.78 | 8.29 | 33.85 | |
| BMNBackbone=TSN, RGB-Only=false2022.05 | 50.07 | 34.78 | 8.29 | 33.85 | |
| BMNBackbone=TSN, E2E=false, Flow=true2023.11 | 50.07 | 34.78 | 8.29 | 33.85 | |
| BMNclassifier=[33]2020.08 | 50.07 | 34.78 | 8.29 | 33.85 | |
| SP-TADBackbone=I3D, RGB-Only=false2022.05 | 50.06 | 32.92 | 8.44 | 32.99 | |
| PlusTAD (Anchor-based)Backbone=R50-SlowOnly, RGB-Only=true, Resolution=224, Input Frames=962022.05 | 50.04 | 33.79 | 2.75 | 32.13 | |
| MUSESFeature=I3D2024.04 | 50 | 35 | 6.6 | 34 | |
| BMNLabel Percentage=90%, Reference=ICCV'19, Classifier=[55]2021.04 | 49.94 | 33.73 | 8.23 | 33.74 | |
| Ji et al.Label Percentage=60%, Reference=ICCV'19, Classifier=[55]2021.04 | 49.82 | 34.53 | 7.01 | 33.52 | |
| ReActType=DETR-based, FLOPs(G)=0.382022.07 | 49.6 | 33 | 8.6 | 32.6 | |
| ReActFeature=3DCNN2024.04 | 49.6 | 33 | 8.6 | 32.6 | |
| BMNLabel Percentage=60%, Reference=ICCV'19, Classifier=[55]2021.04 | 49.5 | 33.68 | 8.15 | 33.17 | |
| TadTrType=DETR-based, FLOPs(G)=0.382022.07 | 49.1 | 32.6 | 8.5 | 32.3 | |
| TadTRFeature=I3D2024.04 | 49.1 | 32.6 | 8.5 | 32.3 | |
| TadTRBackbone=I3D, E2E=false, Flow=true2023.11 | 49.1 | 32.6 | 8.5 | 32.3 | |
| TSA-NetFeature=P3D2024.04 | 48.7 | 32 | 9 | 31.9 | |
| PGCNType=Anchor-based, FLOPs(G)=5.02022.07 | 48.3 | 33.2 | 3.3 | 31.1 |