Action Recognition on MMG-Ego4D 1.0 (test)
63Accuracy (5-way 5-shot)Proposed Multimodal Model
Evaluation Results
| Method | Links | |
|---|---|---|
| Proposed Multimodal ModelEval. Setting=Regular, Support Modalities=Video, Audio, IMU, Query Modalities=Video, Audio, IMU2023.05 | 63 | |
| Proposed Multimodal ModelEval. Setting=Missing Modality, Support Modalities=Video, Audio, IMU, Query Modalities=Video2023.05 | 62.79 | |
| Proposed Multimodal ModelEval. Setting=Missing Modality, Support Modalities=Video, Audio, IMU, Query Modalities=Audio, IMU2023.05 | 62.68 | |
| Proposed Multimodal ModelEval. Setting=Missing Modality, Support Modalities=Video, Audio, IMU, Query Modalities=Video, Audio2023.05 | 61.76 | |
| Proposed Multimodal ModelEval. Setting=Zero-Shot Evaluation, Support Modalities=Video, Query Modalities=IMU2023.05 | 50.8 | |
| Proposed Multimodal ModelEval. Setting=Missing Modality, Support Modalities=Video, Audio, IMU, Query Modalities=Video, IMU2023.05 | 50.77 | |
| Proposed Multimodal ModelEval. Setting=Zero-Shot Evaluation, Support Modalities=IMU, Query Modalities=Video2023.05 | 49.37 | |
| Proposed Multimodal ModelEval. Setting=Missing Modality, Support Modalities=Video, Audio, IMU, Query Modalities=IMU2023.05 | 47.48 | |
| Proposed Multimodal ModelEval. Setting=Zero-Shot Evaluation, Support Modalities=Video, Query Modalities=Audio, IMU2023.05 | 46.9 | |
| Proposed Multimodal ModelEval. Setting=Zero-Shot Evaluation, Support Modalities=Audio, Query Modalities=Video2023.05 | 46.56 | |
| Proposed Multimodal ModelEval. Setting=Zero-Shot Evaluation, Support Modalities=Audio, IMU, Query Modalities=Video2023.05 | 44.01 | |
| Proposed Multimodal ModelEval. Setting=Missing Modality, Support Modalities=Video, Audio, IMU, Query Modalities=Audio2023.05 | 43.65 | |
| Proposed Multimodal ModelEval. Setting=Zero-Shot Evaluation, Support Modalities=Video, Query Modalities=Audio2023.05 | 42.07 |