Video Action Recognition on HMDB51 (test)
84.3AccuracySMART
Evaluation Results
| Method | Links | |
|---|---|---|
| SMARTBackbone=TSN-Inception-V3 (24M), Training Dataset=K400, Training Years=0.07, Protocol=Fine-tuning2021.03 | 84.3 | |
| BraVeConfig=V+FA, Backbone=TSM-50x2 (93.9M), Training Dataset=AS, Training Years=1, Training Modalities=VFA, Protocol=Fine-tuning2021.03 | 79.4 | |
| BraVeConfig=V+FA, Backbone=TSM-50 (23.5M), Training Dataset=AS, Training Years=1, Training Modalities=VFA, Protocol=Fine-tuning2021.03 | 78 | |
| BraVeConfig=V+A, Backbone=TSM-50 (23.5M), Training Dataset=AS, Training Years=1, Training Modalities=VA, Protocol=Fine-tuning2021.03 | 76.5 | |
| BraVeConfig=V+F×3, Backbone=R3D50 (31.8M), Training Dataset=K600, Training Years=0.1, Training Modalities=VF, Protocol=Fine-tuning2021.03 | 76 | |
| S3DBackbone=S3D (9.1M), Training Dataset=IN+K400, Training Years=0.07, Protocol=Fine-tuning2021.03 | 75.9 | |
| ρBYOLBackbone=S3D (9.1M), Training Dataset=K400, Training Years=0.07, Training Modalities=V, Protocol=Fine-tuning2021.03 | 75 | |
| BraVeConfig=V+F×3, Backbone=TSM-50 (23.5M), Training Dataset=K600, Training Years=0.1, Training Modalities=VF, Protocol=Fine-tuning2021.03 | 74.9 | |
| BraVeConfig=V+F×3, Backbone=R3D50 (31.8M), Training Dataset=K400, Training Years=0.07, Training Modalities=VF, Protocol=Fine-tuning2021.03 | 74.6 | |
| BraVeConfig=V+V×3, Backbone=TSM-50 (23.5M), Training Dataset=K600, Training Years=0.1, Training Modalities=V, Protocol=Fine-tuning2021.03 | 74.6 | |
| BraVeConfig=V+V×3, Backbone=R3D50 (31.8M), Training Dataset=K600, Training Years=0.1, Training Modalities=V, Protocol=Fine-tuning2021.03 | 74.2 | |
| ρBYOLBackbone=R3D50 (31.8M), Training Dataset=K400, Training Years=0.07, Training Modalities=V, Protocol=Fine-tuning2021.03 | 73.6 | |
| BraVeConfig=V+FA, Backbone=R(2+1)D-50 (46.9M), Training Dataset=AS, Training Years=1, Training Modalities=VFA, Protocol=Fine-tuning2021.03 | 73.5 | |
| BraVeConfig=V+V×3, Backbone=R3D50 (31.8M), Training Dataset=K400, Training Years=0.07, Training Modalities=V, Protocol=Fine-tuning2021.03 | 71.9 | |
| R(2+1)D-50Backbone=R(2+1)D-50 (46.9M), Training Dataset=K400, Training Years=0.07, Protocol=Fine-tuning2021.03 | 71.5 | |
| BraVeConfig=V+A, Backbone=R(2+1)D-18 (33.3M), Training Dataset=AS, Training Years=1, Training Modalities=VA, Protocol=Fine-tuning2021.03 | 70.8 | |
| MMVBackbone=R(2+1)D-18 (33.3M), Training Dataset=AS, Training Years=1, Training Modalities=VA, Protocol=Fine-tuning2021.03 | 70.1 | |
| BraVeConfig=V+FA, Backbone=TSM-50x2 (93.9M), Training Dataset=AS, Training Years=1, Training Modalities=VFA, Protocol=Linear2021.03 | 69.9 | |
| BraVeConfig=V+F×3, Backbone=R3D50 (31.8M), Training Dataset=K600, Training Years=0.1, Training Modalities=VF, Protocol=Linear2021.03 | 69.5 | |
| BraVeConfig=V+A, Backbone=TSM-50 (23.5M), Training Dataset=AS, Training Years=1, Training Modalities=VA, Protocol=Linear2021.03 | 69.4 | |
| BraVeConfig=V+FA, Backbone=TSM-50 (23.5M), Training Dataset=AS, Training Years=1, Training Modalities=VFA, Protocol=Linear2021.03 | 69.2 | |
| XDCBackbone=R(2+1)D-18 (33.3M), Training Dataset=IG65M, Training Years=21, Training Modalities=VA, Protocol=Fine-tuning2021.03 | 68.9 | |
| BraVeConfig=V+F×3, Backbone=R3D50 (31.8M), Training Dataset=K400, Training Years=0.07, Training Modalities=VF, Protocol=Linear2021.03 | 68.3 | |
| CVRLBackbone=R3D50 (31.8M), Training Dataset=K600, Training Years=0.1, Training Modalities=V, Protocol=Fine-tuning2021.03 | 68 | |
| ELoBackbone=R(2+1)D-50 (46.9M), Training Dataset=YT8M, Training Years=13, Training Modalities=VFA, Protocol=Fine-tuning2021.03 | 67.4 | |
| BraVeConfig=V+F×3, Backbone=TSM-50 (23.5M), Training Dataset=K600, Training Years=0.1, Training Modalities=VF, Protocol=Linear2021.03 | 66.8 | |
| BraVeConfig=V+V×3, Backbone=R3D50 (31.8M), Training Dataset=K600, Training Years=0.1, Training Modalities=V, Protocol=Linear2021.03 | 66.7 | |
| BraVeConfig=V+FA, Backbone=R(2+1)D-50 (46.9M), Training Dataset=AS, Training Years=1, Training Modalities=VFA, Protocol=Linear2021.03 | 66.6 | |
| GDTBackbone=R(2+1)D-18 (33.3M), Training Dataset=AS, Training Years=1, Training Modalities=VA, Protocol=Fine-tuning2021.03 | 66.1 | |
| BraVeConfig=V+V×3, Backbone=TSM-50 (23.5M), Training Dataset=K600, Training Years=0.1, Training Modalities=V, Protocol=Linear2021.03 | 65.4 | |
| CVRLBackbone=R3D, Resolution=224, Pre-training=Kinetics-400, Evaluation Protocol=Fine-tuning2021.08 | 65.4 | |
| R(2+1)D-18Backbone=R(2+1)D-18 (33.3M), Training Dataset=K400, Training Years=0.07, Protocol=Fine-tuning2021.03 | 65.1 | |
| AVIDBackbone=R(2+1)D-50 (46.9M), Training Dataset=AS, Training Years=1, Training Modalities=VA, Protocol=Fine-tuning2021.03 | 64.7 | |
| ELoBackbone=R(2+1)D-50 (46.9M), Training Dataset=YT8M, Training Years=13, Training Modalities=VFA, Protocol=Linear2021.03 | 64.5 | |
| BraVeConfig=V+V×3, Backbone=R3D50 (31.8M), Training Dataset=K400, Training Years=0.07, Training Modalities=V, Protocol=Linear2021.03 | 64.4 | |
| XDCBackbone=R(2+1)D-18 (33.3M), Training Dataset=AS, Training Years=1, Training Modalities=VA, Protocol=Fine-tuning2021.03 | 63.7 | |
| BraVeConfig=V+A, Backbone=R(2+1)D-18 (33.3M), Training Dataset=AS, Training Years=1, Training Modalities=VA, Protocol=Linear2021.03 | 63.6 | |
| MMVBackbone=R(2+1)D-18 (33.3M), Training Dataset=AS, Training Years=1, Training Modalities=VA, Protocol=Linear2021.03 | 60 | |
| CVRLBackbone=R3D50 (31.8M), Training Dataset=K600, Training Years=0.1, Training Modalities=V, Protocol=Linear2021.03 | 59.7 | |
| MCNBackbone=R3D, Resolution=128, Pre-training=Kinetics-400, Evaluation Protocol=Fine-tuning2021.08 | 59.3 | |
| MCNBackbone=R(2+1)D, Resolution=128, Pre-training=Kinetics-400, Evaluation Protocol=Fine-tuning2021.08 | 58.8 | |
| AWTEvaluation Protocol=EP2, Zero-shot=true2024.07 | 57.2 | |
| AWTEvaluation Protocol=EP1, Zero-shot=true2024.07 | 56.1 | |
| FROSTEREvaluation Protocol=EP2, Zero-shot=true2024.07 | 54.8 | |
| CoCLRBackbone=S3D (9.1M), Training Dataset=K400, Training Years=0.07, Training Modalities=VF, Protocol=Fine-tuning2021.03 | 54.6 | |
| CoCLRBackbone=S3D, Resolution=128, Pre-training=Kinetics-400, Evaluation Protocol=Fine-tuning2021.08 | 54.6 | |
| FROSTEREvaluation Protocol=EP1, Zero-shot=true2024.07 | 54.5 | |
| Open-VCLIPEvaluation Protocol=EP2, Zero-shot=true2024.07 | 53.9 | |
| Open-VCLIPEvaluation Protocol=EP1, Zero-shot=true2024.07 | 53.2 | |
| ViFi-CLIPEvaluation Protocol=EP2, Zero-shot=true2024.07 | 51.3 | |
| ST-AdapterEvaluation Protocol=EP2, Zero-shot=true2024.07 | 51.1 | |
| AdaptFormerEvaluation Protocol=EP2, Zero-shot=true2024.07 | 51 | |
| AdaptFormerEvaluation Protocol=EP1, Zero-shot=true2024.07 | 50.5 | |
| AIMEvaluation Protocol=EP2, Zero-shot=true2024.07 | 50.3 | |
| ST-AdapterEvaluation Protocol=EP1, Zero-shot=true2024.07 | 50.3 | |
| Text4VisEvaluation Protocol=EP1, Zero-shot=true2024.07 | 49.8 | |
| AIMEvaluation Protocol=EP1, Zero-shot=true2024.07 | 49.5 | |
| SpeedNetBackbone=S3D-G, Resolution=224, Pre-training=Kinetics-400, Evaluation Protocol=Fine-tuning2021.08 | 48.8 | |
| Vita-CLIPEvaluation Protocol=EP2, Zero-shot=true2024.07 | 48.6 | |
| ActionCLIPEvaluation Protocol=EP2, Zero-shot=true2024.07 | 48.2 | |
| ActionCLIPEvaluation Protocol=EP1, Zero-shot=true2024.07 | 48 | |
| CoCLRBackbone=S3D (9.1M), Training Dataset=K400, Training Years=0.07, Training Modalities=VF, Protocol=Linear2021.03 | 46.1 | |
| X-CLIPEvaluation Protocol=EP2, Zero-shot=true2024.07 | 44.6 | |
| Ju et al.Evaluation Protocol=EP2, Zero-shot=true2024.07 | 44.3 | |
| MCNEvaluation Protocol=Linear probe, Backbone=R3D-182021.08 | 42.9 | |
| MCNEvaluation Protocol=Linear probe, Backbone=R(2+1)D2021.08 | 42.2 | |
| CoCLREvaluation Protocol=Linear probe2021.08 | 39.1 | |
| PPBackbone=R(2+1)D, Resolution=112, Pre-training=Kinetics-400, Evaluation Protocol=Fine-tuning2021.08 | 35.9 | |
| DPCBackbone=R2D-3D, Resolution=128, Pre-training=Kinetics-400, Evaluation Protocol=Fine-tuning2021.08 | 35.7 | |
| 3D-RotNetBackbone=R3D, Resolution=112, Pre-training=Kinetics-400, Evaluation Protocol=Fine-tuning2021.08 | 33.7 | |
| ST-PuzzleBackbone=R3D, Resolution=224, Pre-training=Kinetics-400, Evaluation Protocol=Fine-tuning2021.08 | 33.7 | |
| MemDPCEvaluation Protocol=Linear probe2021.08 | 30.5 | |
| CBTEvaluation Protocol=Linear probe2021.08 | 29.5 |