Action Recognition on EPIC-Kitchens (val)
77.1Verb Top-1 AccTIM
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| TIMModality=Audio-visual, input resolution=224p, LLM pre-training=false2024.04 | 77.1 | — | 67.2 | — | 57.5 | — | |
| TIMModality=Visual-only, input resolution=224p, LLM pre-training=false2024.04 | 76.2 | — | 66.4 | — | 56.4 | — | |
| AVION (ViT-L)Modality=Visual-only, input resolution=224p, LLM pre-training=true2024.04 | 73 | — | 65.4 | — | 54.4 | — | |
| MoViNetModels=MoViNet2022.06 | 72.2 | — | 57.3 | — | 47.7 | — | |
| MoViNet-A6Modality=Visual-only, input resolution=320p, LLM pre-training=false2024.04 | 72.2 | — | 57.3 | — | 47.7 | — | |
| M&M-BModels=B/2:R+S/4:S+Ti/8:F, Ensemble=false2022.06 | 72 | — | 66.3 | — | 53.6 | — | |
| LaViLa (TSF-L)Modality=Visual-only, input resolution=224p, LLM pre-training=true2024.04 | 72 | — | 62.9 | — | 51 | — | |
| M&MModality=Audio-visual, input resolution=420p, LLM pre-training=false2024.04 | 72 | — | 66.3 | — | 53.6 | — | |
| MeMViTModels=MeMViT2022.06 | 71.4 | — | 60.3 | — | 48.4 | — | |
| MeMVITModality=Visual-only, input resolution=224p, LLM pre-training=false2024.04 | 71.4 | — | 60.3 | — | 48.4 | — | |
| MTCNModality=Audio-visual, input resolution=336p, LLM pre-training=false2024.04 | 70.7 | — | 62.1 | — | 49.6 | — | |
| MTVModality=Visual-only, input resolution=280p, LLM pre-training=false2024.04 | 69.9 | — | 63.9 | — | 50.5 | — | |
| OmnivoreModels=Omnivore2022.06 | 69.5 | — | 61.7 | — | 49.9 | — | |
| OmnivoreModality=Visual-only, input resolution=224p, LLM pre-training=false2024.04 | 69.5 | — | 61.7 | — | 49.9 | — | |
| MFormer-HRModality=Visual-only, input resolution=336p, LLM pre-training=false2024.04 | 67 | — | 58.5 | — | 44.5 | — | |
| TBNModality=Audio-visual, input resolution=224p, LLM pre-training=false2024.04 | 66 | — | 47.2 | — | 36.7 | — | |
| MBTModality=Audio-visual, input resolution=224p, LLM pre-training=false2024.04 | 64.8 | — | 58 | — | 43.4 | — | |
| TSN + TPNFrames=82020.04 | 61.1 | — | 41.3 | — | — | — | |
| AssembleNet++ ODF+SDFSK Size=exact2020.01 | 60 | 86.7 | 37.1 | 59.2 | 25.2 | 43.4 | |
| G-BlendModality=Audio-Visual2019.05 | 59.2 | 84.5 | 36.1 | 58.5 | 25.6 | 43.5 | |
| AssembleNet++ ODF+SDFSK Size=10242020.01 | 58.7 | 85.6 | 36 | 57.3 | 24.7 | 43 | |
| WeakLargeScale2020.01 | 58.4 | 84.1 | 36.9 | 60.3 | 26.1 | 42.7 | |
| Naive A/V: 152Modality=Audio-Visual2019.05 | 57.4 | 83.3 | 34.8 | 56.7 | 23.7 | 41.2 | |
| AssembleNet++ ODF+SDFSK Size=5122020.01 | 57.2 | 84.6 | 34.8 | 56.4 | 23.2 | 41.3 | |
| Visual: ip-CSN-152Modality=Visual2019.05 | 56.6 | 84.1 | 36.4 | 58.9 | 24.9 | 42.5 | |
| Ours SAPPre-training=Kinetics2020.02 | 55.9 | 81.9 | 35 | 60.4 | 25 | 44.7 | |
| DEEP-HAL+ODF+SDFSK Size=10242020.01 | 55.4 | 82.9 | 33.3 | 55.1 | 21.5 | 39.7 | |
| Ours BaselinePre-training=Kinetics2020.02 | 54.6 | 80.9 | 23.8 | 45.1 | 19.5 | 36 | |
| LFB MaxPre-training=Kinetics+ImageNet2020.02 | 52.6 | 81.2 | 31.8 | 56.8 | 22.8 | 41.1 | |
| LFB MaxPooling=Max2020.01 | 52.6 | 81.2 | 31.8 | 56.8 | 22.8 | 41.1 | |
| TSN (Fusion)Frames=252020.04 | 48.2 | — | 36.7 | — | — | — | |
| TSN (our impl.)Frames=82020.04 | 48.2 | — | 39.7 | — | — | — | |
| R(2+1)D 34Pre-training=Kinetics2020.02 | 46.8 | 79.2 | 25.6 | 47.5 | 15.3 | 29.4 | |
| TSN (RGB)Frames=252020.04 | 45.7 | — | 36.8 | — | — | — | |
| TSN (Flow)Frames=252020.04 | 42.8 | — | 17.4 | — | — | — | |
| ORNPre-training=ImageNet2020.02 | 40.9 | — | — | — | — | — | |
| I3D GFAPre-training=Kinetics+ImageNet2020.02 | — | — | 34.1 | 60.4 | — | — |