Video Classification on Something-something v1 (val)
54.7Top-1 AccVoV3D-L
Evaluation results
| Method | Links | ||
|---|---|---|---|
| VoV3D-LPretrain=Kinetics, Frame=32, Param (M)=5.8, GFLOPS=24.3 x 62020.12 | 54.7 | 82 | |
| VoV3D-MPretrain=Kinetics, Frame=32, Param (M)=3.2, GFLOPS=12.8 x 62020.12 | 53.2 | 81.1 | |
| TSMRGB+FlowBackbone=ResNet-50, #Frame=16+16, #Param.=48.6M2018.11 | 52.6 | 81.9 | |
| TEABackbone=ResNet-50, Pretrain=ImageNet, Frame=16, Param (M)=24.4, GFLOPS=70 x 302020.12 | 52.3 | 81.9 | |
| TEABackbone=ResNet-50, Pretrain=ImageNet, Frame=8, Param (M)=24.4, GFLOPS=35 x 302020.12 | 51.7 | 80.5 | |
| E3D-LBackbone=E3D-L, Pretrain=No pretrain, Resolution=16 x 312^2, GFLOPs=18.3, Testing Strategy=1x12023.03 | 51.1 | 78.7 | |
| TSM+TPNBackbone=ResNet-50, Pretrain=ImageNet, Frame=82020.12 | 50.7 | — | |
| STMBackbone=ResNet-50, Pretrain=ImageNet, Frame=16, GFLOPS=67 x 302020.12 | 50.7 | 80.4 | |
| VoV3D-LFrame=32, Param (M)=5.8, GFLOPS=24.3 x 62020.12 | 50.7 | 78.8 | |
| VoV3D-MFrame=32, Param (M)=3.2, GFLOPS=12.8 x 62020.12 | 49.8 | 78 | |
| TSMEnBackbone=ResNet-50, #Frame=24, FLOPs/Video=98G, #Param.=48.6M2018.11 | 49.7 | 78.5 | |
| ECOEnLiteRGB+FlowBackbone=BNIncep+3D Res18, #Frame=92+92, #Param.=300M2018.11 | 49.5 | — | |
| VoV3D-LFrame=16, Param (M)=5.8, GFLOPS=12.1 x 62020.12 | 49.5 | 78 | |
| X3D-LBackbone=X3D-L, Pretrain=No pretrain, Resolution=16 x 312^2, GFLOPs=18.4, Testing Strategy=1x12023.03 | 49.4 | 77.9 | |
| E3D-MBackbone=E3D-M, Pretrain=No pretrain, Resolution=16 x 224^2, GFLOPs=4.7, Testing Strategy=1x12023.03 | 49.4 | 78.1 | |
| ip-CSN-152Frame=32, Param (M)=29.7, GFLOPS=74.0 x 102020.12 | 49.3 | — | |
| MoViNet-A1Backbone=MoViNet-A1, Pretrain=No pretrain, Resolution=50 x 172^2, GFLOPs=6, Testing Strategy=1x12023.03 | 49.3 | 77.1 | |
| I3D + RSTGBackbone=3D ResNet-502019.04 | 49.2 | 78.8 | |
| VoV3D-MFrame=16, Param (M)=3.2, GFLOPS=6.4 x 62020.12 | 49 | 78.2 | |
| TSMBackbone=ResNet-101, Pretrain=Kinetics, Frame=8, Param (M)=24.3, GFLOPS=65 x 62020.12 | 48.7 | 77.2 | |
| S3D-GBackbone=Inception, Input Features=RGB2017.12 | 48.2 | 78.7 | |
| S3D-GBackbone=3D Inception2019.04 | 48.2 | 78.7 | |
| S3D-GBackbone=InceptionV1, Pretrain=ImageNet, Resolution=64 x 256^2, GFLOPs=71.4, Testing Strategy=1x12023.03 | 48.2 | 78.7 | |
| TANetBackbone=ResNet50, Pretrain=ImageNet, Resolution=16 x 256^2, GFLOPs=66, Testing Strategy=1x12023.03 | 47.6 | 77.7 | |
| S3DBackbone=Inception, Input Features=RGB2017.12 | 47.3 | 78.1 | |
| X3D-MBackbone=X3D-M, Pretrain=No pretrain, Resolution=16 x 224^2, GFLOPs=4.7, Testing Strategy=1x12023.03 | 47.3 | 76.6 | |
| TSMBackbone=ResNet-50, #Frame=16, FLOPs/Video=65G, #Param.=24.3M2018.11 | 47.2 | 77.1 | |
| TSM_16FFLOPs=65G, Param.=24.3M, Latency=29.0ms, Thrput.=39.5V/s2018.11 | 47.2 | — | |
| TSMBackbone=ResNet-50, Pretrain=Kinetics, Frame=16, Param (M)=24.3, GFLOPS=33 x 62020.12 | 47.2 | 77 | |
| TSMBackbone=ResNet50, Pretrain=ImageNet, Resolution=16 x 256^2, GFLOPs=65, Testing Strategy=1x12023.03 | 47.2 | 77.1 | |
| X3D-LFrame=16, Param (M)=5.6, GFLOPS=12.0 x 62020.12 | 47.1 | 76.5 | |
| E3D-SBackbone=E3D-S, Pretrain=No pretrain, Resolution=13 x 160^2, GFLOPs=1.9, Testing Strategy=1x12023.03 | 47.1 | 75.6 | |
| MoViNet-A0Backbone=MoViNet-A0, Pretrain=No pretrain, Resolution=50 x 172^2, GFLOPs=2.7, Testing Strategy=1x12023.03 | 46.9 | 75 | |
| ECOEnLiteBackbone=BNIncep+3D Res18, #Frame=92, FLOPs/Video=267G, #Param.=150M2018.11 | 46.4 | — | |
| X3D-MFrame=16, Param (M)=3.3, GFLOPS=6.1 x 62020.12 | 46.4 | 75.3 | |
| NL I3D + Joint GCNbackbone=ResNet-502018.06 | 46.1 | 76.8 | |
| Non-local I3D + GCNBackbone=3D ResNet-50+GCN, #Frame=32x2clip, FLOPs/Video=303G^2x2, #Param.=62.2M^22018.11 | 46.1 | 76.8 | |
| NL I3D + Joint GCNBackbone=3D ResNet-502019.04 | 46.1 | 76.8 | |
| NL-I3D+GCNBackbone=3D ResNet-50, Pretrain=Kinetics, Frame=32, GFLOPS=303 x 62020.12 | 46.1 | 76.8 | |
| I3DBackbone=Inception, Input Features=RGB2017.12 | 45.8 | 76.5 | |
| I3DBackbone=3D Inception2019.04 | 45.8 | 76.5 | |
| TSMBackbone=ResNet-50, #Frame=8, FLOPs/Video=33G, #Param.=24.3M2018.11 | 45.6 | 74.2 | |
| TSM_8FFLOPs=33G, Param.=24.3M, Latency=17.4ms, Thrput.=77.4V/s2018.11 | 45.6 | — | |
| I3D replaceFLOPs=48G, Param.=33.0M, Latency=28.0ms, Thrput.=37.9V/s2018.11 | 44.9 | — | |
| X3D-SBackbone=X3D-S, Pretrain=No pretrain, Resolution=13 x 160^2, GFLOPs=2, Testing Strategy=1x12023.03 | 44.6 | 74.4 | |
| NL I3Dbackbone=ResNet-502018.06 | 44.4 | 76 | |
| Non-local I3DBackbone=3D ResNet-50, #Frame=32x2clip, FLOPs/Video=168G^1x2, #Param.=35.3M2018.11 | 44.4 | 76 | |
| NL I3DBackbone=3D ResNet-502019.04 | 44.4 | 76 | |
| NL I3DBackbone=InceptionV1, Pretrain=ImageNet+K400, Resolution=64 x 256^2, GFLOPs=334, Testing Strategy=1x12023.03 | 44.4 | 76 | |
| MFNet-C101Backbone=3D ResNet-1012019.04 | 43.9 | 73.1 | |
| I3D + Joint GCNbackbone=ResNet-502018.06 | 43.3 | 75.1 | |
| I3D + Spatial-Temporal GCNbackbone=ResNet-502018.06 | 42.8 | 74.7 | |
| C2D + RSTGBackbone=2D ResNet-502019.04 | 42.8 | 73.6 | |
| I3D + Similarity GCNbackbone=ResNet-502018.06 | 42.7 | 74.6 | |
| ECO Lite-16FBackbone=2D Inc+3D Res-182019.04 | 42.2 | — | |
| Two-stream TRNRGB+FlowBackbone=BNInception, #Frame=8+8, #Param.=36.6M2018.11 | 42 | — | |
| I3Dbackbone=ResNet-502018.06 | 41.6 | 72.2 | |
| I3DBackbone=3D ResNet-50, #Frame=32x2clip, FLOPs/Video=153G^1x2, #Param.=28.0M2018.11 | 41.6 | 72.2 | |
| I3DFLOPs=306G, Param.=35.3M, Latency=165.3ms, Thrput.=6.1V/s2018.11 | 41.6 | — | |
| I3DBackbone=3D ResNet-502019.04 | 41.6 | 72.2 | |
| I3DBackbone=InceptionV1, Pretrain=ImageNet+K400, Resolution=64 x 256^2, GFLOPs=306, Testing Strategy=1x12023.03 | 41.6 | 72.2 | |
| ECOBackbone=BNIncep+3D Res18, #Frame=16, FLOPs/Video=64G, #Param.=47.5M2018.11 | 41.4 | — | |
| ECO_16FFLOPs=64G, Param.=47.5M, Latency=30.6ms, Thrput.=45.6V/s2018.11 | 41.4 | — | |
| MFNet-C50Backbone=3D ResNet-502019.04 | 40.3 | 70.9 | |
| ECOBackbone=BNIncep+3D Res18, #Frame=8, FLOPs/Video=32G, #Param.=47.5M2018.11 | 39.6 | — | |
| TRN-Multiscale (our impl.)Backbone=ResNet-50, #Frame=8, FLOPs/Video=33G, #Param.=31.8M2018.11 | 38.9 | 68.1 | |
| Multi-scale TRNBackbone=Inception, Input Features=RGB2017.12 | 34.4 | 63.2 | |
| MultiScale TRNbackbone=Inception2018.06 | 34.4 | 63.2 | |
| TRN-MultiscaleBackbone=BNInception, #Frame=8, FLOPs/Video=16G, #Param.=18.3M2018.11 | 34.4 | — | |
| TRNBackbone=2D Inception2019.04 | 34.4 | — | |
| C2DBackbone=2D ResNet-502019.04 | 31.7 | 64.7 | |
| I2DBackbone=Inception, Input Features=RGB2017.12 | 31.4 | 69 | |
| TSN (our impl.)Backbone=ResNet-50, #Frame=8, FLOPs/Video=33G, #Param.=24.3M2018.11 | 19.7 | 46.6 | |
| TSNBackbone=BNInception, #Frame=8, FLOPs/Video=16G, #Param.=10.7M2018.11 | 19.5 | — | |
| TSNBackbone=ResNet50, Pretrain=ImageNet, Resolution=8 x 256^2, GFLOPs=16, Testing Strategy=1x12023.03 | 19.5 | — |