Video Recognition on SS v2
71.9AccuracySMILE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SMILEProtocol=Finetuning, Pretraining Video Dataset=K4002025.04 | 71.9 | — | |
| UMTProtocol=Finetuning, Pretraining Video Dataset=K7002025.04 | 70.1 | — | |
| ViCLIPProtocol=Finetuning, Pretraining Video Dataset=Intervid-10M2025.04 | 67.9 | — | |
| CLIPProtocol=Finetuning, Pretraining Video Dataset=N/A2025.04 | 66.7 | — | |
| SMILEProtocol=Linear Probing, Pretraining Video Dataset=K4002025.04 | 23.7 | — | |
| ViCLIPProtocol=Linear Probing, Pretraining Video Dataset=Intervid-10M2025.04 | 18.9 | — | |
| UMTProtocol=Linear Probing, Pretraining Video Dataset=K7002025.04 | 18.8 | — | |
| VidPrism-MEvaluation Protocol=Tuning, Shot Count (K)=16, Backbone=VideoMAEv22026.05 | 18.3 | — | |
| ETLEvaluation Protocol=Adapting, Shot Count (K)=162026.05 | 17.5 | — | |
| VideoMAEv2Evaluation Protocol=Tuning, Shot Count (K)=162026.05 | 17.1 | — | |
| ViCLIPEvaluation Protocol=Tuning, Shot Count (K)=162026.05 | 15.4 | — | |
| VidPrism-CEvaluation Protocol=Tuning, Shot Count (K)=16, Backbone=CLIP2026.05 | 14.1 | — | |
| VidPrism-MEvaluation Protocol=Tuning, Shot Count (K)=8, Backbone=VideoMAEv22026.05 | 13.6 | — | |
| ETLEvaluation Protocol=Adapting, Shot Count (K)=82026.05 | 13.4 | — | |
| ViFi-CLIPEvaluation Protocol=Adapting, Shot Count (K)=162026.05 | 12.4 | — | |
| MAXIEvaluation Protocol=Tuning, Shot Count (K)=162026.05 | 12.4 | — | |
| VideoMAEv2Evaluation Protocol=Tuning, Shot Count (K)=82026.05 | 12.2 | — | |
| MoTEEvaluation Protocol=Tuning, Shot Count (K)=162026.05 | 12.2 | — | |
| ViCLIPEvaluation Protocol=Tuning, Shot Count (K)=82026.05 | 11.6 | — | |
| OSTEvaluation Protocol=Tuning, Shot Count (K)=162026.05 | 11.5 | — | |
| CLIPProtocol=Linear Probing, Pretraining Video Dataset=N/A2025.04 | 11.3 | — | |
| ActionCLIPEvaluation Protocol=Adapting, Shot Count (K)=162026.05 | 11.1 | — | |
| X-CLIPEvaluation Protocol=Adapting, Shot Count (K)=162026.05 | 10.6 | — | |
| ETLEvaluation Protocol=Adapting, Shot Count (K)=42026.05 | 10.4 | — | |
| A5Evaluation Protocol=Adapting, Shot Count (K)=162026.05 | 9.7 | — | |
| ViCLIPEvaluation Protocol=Tuning, Shot Count (K)=42026.05 | 9.7 | — | |
| MoTEEvaluation Protocol=Tuning, Shot Count (K)=82026.05 | 9.5 | — | |
| VidPrism-MEvaluation Protocol=Tuning, Shot Count (K)=4, Backbone=VideoMAEv22026.05 | 9.5 | — | |
| VidPrism-CEvaluation Protocol=Tuning, Shot Count (K)=8, Backbone=CLIP2026.05 | 9.3 | — | |
| ETLEvaluation Protocol=Adapting, Shot Count (K)=22026.05 | 9.1 | — | |
| ViCLIPEvaluation Protocol=Tuning, Shot Count (K)=22026.05 | 8.7 | — | |
| VideoMAEv2Evaluation Protocol=Tuning, Shot Count (K)=42026.05 | 8.6 | — | |
| ViFi-CLIPEvaluation Protocol=Adapting, Shot Count (K)=82026.05 | 8.5 | — | |
| OSTEvaluation Protocol=Tuning, Shot Count (K)=82026.05 | 8.5 | — | |
| MoTEEvaluation Protocol=Tuning, Shot Count (K)=42026.05 | 8.5 | — | |
| ActionCLIPEvaluation Protocol=Adapting, Shot Count (K)=82026.05 | 8.4 | — | |
| MAXIEvaluation Protocol=Tuning, Shot Count (K)=82026.05 | 8.4 | — | |
| OSTEvaluation Protocol=Tuning, Shot Count (K)=42026.05 | 8.4 | — | |
| ViFi-CLIPEvaluation Protocol=Adapting, Shot Count (K)=42026.05 | 7.4 | — | |
| MAXIEvaluation Protocol=Tuning, Shot Count (K)=42026.05 | 7.4 | — | |
| MAXIEvaluation Protocol=Tuning, Shot Count (K)=22026.05 | 7.3 | — | |
| OSTEvaluation Protocol=Tuning, Shot Count (K)=22026.05 | 7.3 | — | |
| MoTEEvaluation Protocol=Tuning, Shot Count (K)=22026.05 | 7.3 | — | |
| VidPrism-CEvaluation Protocol=Tuning, Shot Count (K)=4, Backbone=CLIP2026.05 | 7.3 | — | |
| X-CLIPEvaluation Protocol=Adapting, Shot Count (K)=82026.05 | 6.8 | — | |
| VidPrism-MEvaluation Protocol=Tuning, Shot Count (K)=2, Backbone=VideoMAEv22026.05 | 6.4 | — | |
| ViFi-CLIPEvaluation Protocol=Adapting, Shot Count (K)=22026.05 | 6.2 | — | |
| A5Evaluation Protocol=Adapting, Shot Count (K)=82026.05 | 6.1 | — | |
| ActionCLIPEvaluation Protocol=Adapting, Shot Count (K)=42026.05 | 5.3 | — | |
| ViCLIPEvaluation Protocol=Zero-shot, Shot Count (K)=22026.05 | 5.1 | — | |
| ViCLIPEvaluation Protocol=Zero-shot, Shot Count (K)=42026.05 | 5.1 | — | |
| ViCLIPEvaluation Protocol=Zero-shot, Shot Count (K)=82026.05 | 5.1 | — | |
| ViCLIPEvaluation Protocol=Zero-shot, Shot Count (K)=162026.05 | 5.1 | — | |
| A5Evaluation Protocol=Adapting, Shot Count (K)=42026.05 | 5.1 | — | |
| VideoMAEv2Evaluation Protocol=Tuning, Shot Count (K)=22026.05 | 5 | — | |
| VidPrism-CEvaluation Protocol=Tuning, Shot Count (K)=2, Backbone=CLIP2026.05 | 4.9 | — | |
| X-CLIPEvaluation Protocol=Adapting, Shot Count (K)=42026.05 | 4.5 | — | |
| A5Evaluation Protocol=Adapting, Shot Count (K)=22026.05 | 4.4 | — | |
| ActionCLIPEvaluation Protocol=Adapting, Shot Count (K)=22026.05 | 4.4 | — | |
| X-CLIPEvaluation Protocol=Adapting, Shot Count (K)=22026.05 | 3.9 | — | |
| CLIPEvaluation Protocol=Zero-shot, Shot Count (K)=22026.05 | 2.8 | — | |
| CLIPEvaluation Protocol=Zero-shot, Shot Count (K)=42026.05 | 2.8 | — | |
| CLIPEvaluation Protocol=Zero-shot, Shot Count (K)=82026.05 | 2.8 | — | |
| CLIPEvaluation Protocol=Zero-shot, Shot Count (K)=162026.05 | 2.8 | — | |
| A6Shots (K)=2, Pre-training=CLIP2024.10 | — | 4.4 | |
| A6Shots (K)=4, Pre-training=CLIP2024.10 | — | 5.1 | |
| A6Shots (K)=8, Pre-training=CLIP2024.10 | — | 6.1 | |
| A6Shots (K)=16, Pre-training=CLIP2024.10 | — | 9.7 | |
| ActionCLIPShots (K)=2, Pre-training=CLIP2024.10 | — | 4.1 | |
| ActionCLIPShots (K)=4, Pre-training=CLIP2024.10 | — | 5.8 | |
| ActionCLIPShots (K)=8, Pre-training=CLIP2024.10 | — | 8.4 | |
| ActionCLIPShots (K)=16, Pre-training=CLIP2024.10 | — | 11.1 | |
| CLIPShots (K)=2, Pre-training=CLIP2024.10 | — | 2.9 | |
| CLIPShots (K)=4, Pre-training=CLIP2024.10 | — | 2.9 | |
| CLIPShots (K)=8, Pre-training=CLIP2024.10 | — | 2.9 | |
| CLIPShots (K)=16, Pre-training=CLIP2024.10 | — | 2.9 | |
| cViViT-LCausality=causal, Pre-Train=IN-21K, Param (M)=310.8, Number of frames=322024.12 | — | 64.4 | |
| I3DCausality=non-causal, Pre-Train=K400, Param (M)=252024.12 | — | 51.3 | |
| MAXIShots (K)=2, Pre-training=K4002024.10 | — | 7.1 | |
| MAXIShots (K)=4, Pre-training=K4002024.10 | — | 8.4 | |
| MAXIShots (K)=8, Pre-training=K4002024.10 | — | 9.3 | |
| MAXIShots (K)=16, Pre-training=K4002024.10 | — | 12.4 | |
| Mformer-BCausality=non-causal, Pre-Train=IN-21K, Param (M)=114, FLOPs (T)=1.1, Mem (G)=7.32024.12 | — | 66.5 | |
| MoTEShots (K)=2, Pre-training=CLIP2024.10 | — | 7.3 | |
| MoTEShots (K)=4, Pre-training=CLIP2024.10 | — | 8.5 | |
| MoTEShots (K)=8, Pre-training=CLIP2024.10 | — | 9.5 | |
| MoTEShots (K)=16, Pre-training=CLIP2024.10 | — | 12.2 | |
| MSNetCausality=non-causal, Pre-Train=IN-21K, Param (M)=54.6, FLOPs (T)=0.07, Mem (G)=6.542024.12 | — | 64.7 | |
| MViT-BCausality=non-causal, Pre-Train=K400, Param (M)=36.6, FLOPs (T)=0.51, Mem (G)=10.7, Number of frames=322024.12 | — | 67.1 | |
| MViT-BCausality=non-causal, Pre-Train=K400, Param (M)=36.6, FLOPs (T)=1.36, Mem (G)=>24, Number of frames=642024.12 | — | 67.7 | |
| MViT-B-24Causality=non-causal, Pre-Train=K600, Param (M)=36.6, FLOPs (T)=1.36, Mem (G)=>24, Number of frames=322024.12 | — | 68.7 | |
| RViT-LCausality=causal, Pre-Train=K400, Param (M)=72, FLOPs (T)=1.34, Mem (G)=2.12, Number of frames=322024.12 | — | 66.1 | |
| RVIT-XLCausality=causal, Pre-Train=K400, Param (M)=107.7, FLOPs (T)=3.99, Mem (G)=2.33, Number of frames=642024.12 | — | 67.9 | |
| SlowFast R101Causality=non-causal, Pre-Train=K400, Param (M)=53.3, FLOPs (T)=0.32, Mem (G)=4.202024.12 | — | 63.1 | |
| SlowFast R50Causality=non-causal, Pre-Train=K400, Param (M)=34.1, FLOPs (T)=0.19, Mem (G)=3.352024.12 | — | 61.9 | |
| TimeSformer-LCausality=non-causal, Pre-Train=IN-21K, Param (M)=121.4, FLOPs (T)=5.1, Mem (G)=>242024.12 | — | 62.4 | |
| TRecViTCausality=causal, Pre-Train=IN-21K, Param (M)=111.3, FLOPs (T)=1.44, Mem (G)=1.79, Number of frames=322024.12 | — | 66.8 | |
| TRecViTCausality=causal, Pre-Train=IN-21K, Param (M)=111.3, FLOPs (T)=2.89, Mem (G)=3.16, Number of frames=642024.12 | — | 68.2 | |
| TSM*Causality=causal, Pre-Train=K400, Param (M)=42.9, FLOPs (T)=0.19, Mem (G)=5.982024.12 | — | 63.3 | |
| VideoMambaCausality=non-causal, Pre-Train=IN-21K, Param (M)=74, FLOPs (T)=0.332024.12 | — | 68.4 |