Video Classification on Something-something v1 (test)
63.7Top-1 AccuracyTAdaFormer-L/14
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| TAdaFormer-L/14#frames=32, GFLOPs x views=1716x3x2, Initialization=CLIP-400M2023.08 | 63.7 | — | — | |
| UniFormerV2-L/14#frames=32, GFLOPs x views=~1716x3x2, Initialization=CLIP-400M2023.08 | 62.9 | — | — | |
| TAdaFormer-L/14#frames=16, GFLOPs x views=858x3x2, Initialization=CLIP-400M2023.08 | 62 | — | — | |
| TAdaFormer-B/16#frames=32, GFLOPs x views=374x3x2, Initialization=CLIP-400M2023.08 | 61.2 | — | — | |
| UniFormer-BPre-training=K600, Sampling (frame x crop x clip)=32x3x2, FLOPs (G)=15542022.01 | 61.2 | 87.6 | — | |
| UniFormer-BPre-training=K600, Sampling (frame x crop x clip)=32x3x1, FLOPs (G)=7772022.01 | 61 | 87.6 | — | |
| UniFormer-BPre-training=K400, Sampling (frame x crop x clip)=32x3x2, FLOPs (G)=15542022.01 | 61 | 87.3 | — | |
| UniFormer-BPre-training=K400, Sampling (frame x crop x clip)=32x3x1, FLOPs (G)=7772022.01 | 60.9 | 87.3 | — | |
| TAdaConvNeXtV2-B#frames=32, GFLOPs x views=324x3x2, Initialization=ImageNet21K+K4002023.08 | 60.7 | — | — | |
| TAdaConvNeXtV2-S#frames=32, GFLOPs x views=183x3x2, note=second entry in table2023.08 | 59.7 | — | — | |
| UniFormerV2-B/16#frames=32, GFLOPs x views=~370x3x2, Initialization=CLIP-400M2023.08 | 59.5 | — | — | |
| TAdaFormer-B/16#frames=16, GFLOPs x views=187x3x2, Initialization=CLIP-400M2023.08 | 59.2 | — | — | |
| UniFormer-BPre-training=K400, Sampling (frame x crop x clip)=16x3x1, FLOPs (G)=2902022.01 | 59.1 | 86.2 | — | |
| UniFormer-BPre-training=K600, Sampling (frame x crop x clip)=16x3x1, FLOPs (G)=2902022.01 | 58.8 | 86.5 | — | |
| TAdaConvNeXtV2-S#frames=32, GFLOPs x views=183x3x22023.08 | 58.5 | — | — | |
| UniFormer-SPre-training=K600, Sampling (frame x crop x clip)=16x3x1, FLOPs (G)=1252022.01 | 57.6 | 84.9 | — | |
| UniFormer-SPre-training=K400, Sampling (frame x crop x clip)=16x3x1, FLOPs (G)=1252022.01 | 57.2 | 84.9 | — | |
| TDN-R101#frames=8+16, GFLOPs x views=258x1x12023.08 | 56.8 | — | — | |
| TDNENPre-training=IN-1K, Sampling (frame x crop x clip)=8+16, FLOPs (G)=1982022.01 | 56.8 | 84.1 | — | |
| CT-NetENPre-training=IN-1K, Sampling (frame x crop x clip)=8+12+16+24, FLOPs (G)=2802022.01 | 56.6 | 83.9 | — | |
| MLP-3D-LPre-train=IN-1K, GFLOPs=336, Views=1 x 3, Params=149.42022.06 | 56.5 | 83.5 | — | |
| TAdaConvNeXtV2-T#frames=32, GFLOPs x views=94x3x22023.08 | 56.4 | — | — | |
| MLP-3D-MPre-train=IN-1K, GFLOPs=183, Views=1 x 3, Params=88.32022.06 | 56.2 | 83.5 | — | |
| TAdaConvNeXtV2-S#frames=16, GFLOPs x views=91x3x22023.08 | 55.6 | — | — | |
| TDNPre-train=IN-1K, GFLOPs=132, Views=1 x 12022.06 | 55.3 | 83.3 | — | |
| MLP-3D-SPre-train=IN-1K, GFLOPs=108, Views=1 x 3, Params=74.12022.06 | 55.2 | 83.2 | — | |
| MLP-3D-XSPre-train=IN-1K, GFLOPs=60, Views=1 x 3, Params=55.12022.06 | 54.4 | 82.5 | — | |
| UniFormer-SPre-training=K600, Sampling (frame x crop x clip)=16x1x1, FLOPs (G)=422022.01 | 54.4 | 81.8 | — | |
| TAdaConvNeXtV2-T#frames=16, GFLOPs x views=47x3x22023.08 | 54.1 | — | — | |
| TDNPre-training=IN-1K, Sampling (frame x crop x clip)=16x1x1, FLOPs (G)=722022.01 | 53.9 | 82.1 | — | |
| UniFormer-SPre-training=K400, Sampling (frame x crop x clip)=16x1x1, FLOPs (G)=422022.01 | 53.8 | 81.9 | — | |
| ip-CSN-152*pretrain=IG-65M2019.04 | 53.3 | — | — | |
| CorrNet-101Pretrain=Sports1M, Two stream=false, test_clips=302019.06 | 53.3 | — | — | |
| MARS+RGB+FlowPretrain=Kinetics, Two stream=true2019.06 | 53 | — | — | |
| DG-P3DPre-train=IN-1K, GFLOPs=123, Views=10 x 32022.06 | 52.8 | 81.8 | — | |
| CT-NetPre-training=IN-1K, Sampling (frame x crop x clip)=16x1x1, FLOPs (G)=752022.01 | 52.5 | 80.9 | — | |
| TEAPre-train=IN-1K, GFLOPs=70, Views=10 x 32022.06 | 52.3 | 81.9 | — | |
| ir-CSN-152*pretrain=IG-65M2019.04 | 52.1 | — | — | |
| MSNetPre-train=IN-1K, GFLOPs=67, Views=1 x 1, Params=24.62022.06 | 52.1 | 82.3 | — | |
| MSNetPre-training=IN-1K, Sampling (frame x crop x clip)=16x1x1, FLOPs (G)=1012022.01 | 52.1 | 82.3 | — | |
| TEAPre-training=IN-1K, Sampling (frame x crop x clip)=16x1x1, FLOPs (G)=702022.01 | 51.9 | 80.3 | — | |
| MARS+RGBPretrain=Kinetics, Two stream=false2019.06 | 51.7 | — | — | |
| CorrNet-101Pretrain=None, Two stream=false, test_clips=302019.06 | 51.7 | — | — | |
| R(2+1)D-152*pretrain=IG-65M2019.04 | 51.6 | — | — | |
| SmallBigPre-train=IN-1K, GFLOPs=157, Views=2 x 32022.06 | 51.4 | 80.7 | — | |
| CorrNet-101Pretrain=None, Two stream=false, test_clips=102019.06 | 50.9 | — | — | |
| TSM-FFNParameters=25.7M, Number of Frames=16 Frame (16F)2023.03 | 50.79 | — | 65.5 | |
| TSMRGB+FlowBackbone=ResNet-50, #Frame=16+16, #Param.=48.6M2018.11 | 50.7 | — | — | |
| STMPre-train=IN-1K, GFLOPs=66, Views=10 x 3, Params=24.02022.06 | 50.7 | 80.4 | — | |
| TEINetPre-training=IN-1K, Sampling (frame x crop x clip)=16x1x1, FLOPs (G)=662022.01 | 49.9 | — | — | |
| ir-CSN-152pretrain=none2019.04 | 49.3 | — | — | |
| CorrNet-50Pretrain=None, Two stream=false2019.06 | 49.3 | — | — | |
| TEANet#frames=16, GFLOPs x views=86x1x12023.08 | 48.9 | — | — | |
| GST-50Pretrain=ImageNet, Two stream=false2019.06 | 48.6 | — | — | |
| GSTPre-training=IN-1K, Sampling (frame x crop x clip)=16x1x1, FLOPs (G)=592022.01 | 48.6 | 77.9 | — | |
| TSMParameters=25.6M, Number of Frames=16 Frame (16F)2023.03 | 48.55 | — | 65.4 | |
| TSM-STParameters=25.6x3M, Number of Frames=16 Frame (16F)2023.03 | 48.55 | — | 65.4 | |
| TSM-MixedSpecification=p = 0.50, Parameters=25.6M, Number of Frames=16 Frame (16F)2023.03 | 48.44 | — | 65.4 | |
| ir-CSN-101pretrain=none2019.04 | 48.4 | — | — | |
| S3D-Gpretrain=ImageNet2019.04 | 48.2 | — | — | |
| S3D-GPretrain=ImageNet, Two stream=true2019.06 | 48.2 | — | — | |
| TSM-FFNParameters=25.7M, Number of Frames=8 Frame (8F)2023.03 | 48.2 | — | 32.8 | |
| TSM-MixedSpecification=p = 0.75, Parameters=25.6M, Number of Frames=16 Frame (16F)2023.03 | 47.81 | — | 65.4 | |
| TANet#frames=16, GFLOPs x views=86x3x22023.08 | 47.6 | — | — | |
| TSM-RGBPre-train=IN-1K, GFLOPs=62, Views=2 x 3, Params=42.92022.06 | 47.2 | 77.1 | — | |
| TSM#frames=16, GFLOPs x views=86x3x22023.08 | 47.2 | — | — | |
| TSMPre-training=IN-1K, Sampling (frame x crop x clip)=16x1x1, FLOPs (G)=662022.01 | 47.2 | 77.1 | — | |
| TSM-ProportionalSpecification=p = 0.75, Parameters=25.6M, Number of Frames=16 Frame (16F)2023.03 | 47.14 | — | 65.4 | |
| TSM-EnsembleParameters=25.6x3M, Number of Frames=16 Frame (16F)2023.03 | 46.82 | — | 65.43 | |
| TSM (ensemble)pretrain=Kinetics2019.04 | 46.8 | — | — | |
| ECO-Netpretrain=ImageNet2019.04 | 46.4 | — | — | |
| TSM-EnsembleParameters=25.6x3M, Number of Frames=8 Frame (8F)2023.03 | 46.25 | — | 32.73 | |
| NL I3D + GCNpretrain=ImageNet2019.04 | 46.1 | — | — | |
| NL I3D-50+GCNPretrain=ImageNet, Two stream=false2019.06 | 46.1 | — | — | |
| TSMBackbone=ResNet-50, #Frame=16, FLOPs/Video=65G, #Param.=24.3M2018.11 | 46 | — | — | |
| R(2+1)DPretrain=Sports1M, Two stream=false2019.06 | 45.7 | — | — | |
| TSM-STParameters=25.6x3M, Number of Frames=8 Frame (8F)2023.03 | 45.63 | — | 32.7 | |
| TSM-ProportionalSpecification=p = 0.50, Parameters=25.6M, Number of Frames=16 Frame (16F)2023.03 | 45.37 | — | 65.4 | |
| NL I3D + Joint GCNbackbone=ResNet-502018.06 | 45 | — | — | |
| Non-local I3D + GCNBackbone=3D ResNet-50+GCN, #Frame=32x2clip, FLOPs/Video=303G^2x2, #Param.=62.2M^22018.11 | 45 | — | — | |
| TSM-ProportionalSpecification=p = 0.50, Parameters=25.6M, Number of Frames=8 Frame (8F)2023.03 | 44.82 | — | 32.7 | |
| TSMpretrain=Kinetics2019.04 | 44.8 | — | — | |
| NL I3Dpretrain=ImageNet2019.04 | 44.4 | — | — | |
| NL I3D-50Pretrain=ImageNet, Two stream=false2019.06 | 44.4 | — | — | |
| ECOEnLiteRGB+FlowBackbone=BNIncep+3D Res18, #Frame=92+92, #Param.=300M2018.11 | 43.9 | — | — | |
| Motion Feature Netpretrain=none2019.04 | 43.9 | — | — | |
| MFNet-C101Pretrain=None, Two stream=false2019.06 | 43.9 | — | — | |
| TSM-ProportionalSpecification=p = 0.75, Parameters=25.6M, Number of Frames=8 Frame (8F)2023.03 | 43.15 | — | 32.7 | |
| TSM-FFNParameters=25.7M, Number of Frames=4 Frame (4F)2023.03 | 42.85 | — | 16.4 | |
| TSM-MixedSpecification=p = 0.75, Parameters=25.6M, Number of Frames=8 Frame (8F)2023.03 | 42.56 | — | 32.7 | |
| ECOEnLiteBackbone=BNIncep+3D Res18, #Frame=92, FLOPs/Video=267G, #Param.=150M2018.11 | 42.3 | — | — | |
| S3D-GBackbone=Inception, Input Features=RGB2017.12 | 42 | — | — | |
| TRNPretrain=ImageNet, Two stream=true2019.06 | 42 | — | — | |
| TSM-MixedSpecification=p = 0.50, Parameters=25.6M, Number of Frames=8 Frame (8F)2023.03 | 41.07 | — | 32.7 | |
| Two-stream TRNRGB+FlowBackbone=BNInception, #Frame=8+8, #Param.=36.6M2018.11 | 40.7 | — | — | |
| TSM-Fine-tuningSpecification=16F->4F, Parameters=25.6M, Number of Frames=8 Frame (8F)2023.03 | 40.37 | — | 32.7 | |
| TSM-Fine-tuningSpecification=16F->4F, Parameters=25.6M, Number of Frames=4 Frame (4F)2023.03 | 39.95 | — | 16.4 | |
| TSM-STParameters=25.6x3M, Number of Frames=4 Frame (4F)2023.03 | 39.71 | — | 16.4 | |
| TSM-ProportionalSpecification=p = 0.50, Parameters=25.6M, Number of Frames=4 Frame (4F)2023.03 | 37.56 | — | 16.4 | |
| TSMParameters=25.6M, Number of Frames=8 Frame (8F)2023.03 | 37.36 | — | 32.7 |