Video Retrieval on HMDB51 (test)
40.1Recall@1ProViCo
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ProViCoBackbone=R3D-18 (20.2M), Pretrain=K4002022.04 | 40.1 | 60.6 | 75.2 | 85.2 | — | |
| TECBackbone=R3D-18 (20.2M), Pretrain=K4002022.04 | 36.4 | 64.1 | 74.1 | 83.8 | — | |
| ProViCoBackbone=R3D-18 (20.2M), Pretrain=UCF1012022.04 | 35.9 | 55.2 | 74.3 | 81.8 | — | |
| CATEBackbone=R3D-50 (31.7M), Pretrain=K4002022.04 | 33 | 56.8 | 69.4 | 82.1 | — | |
| TECBackbone=R3D-18 (20.2M), Pretrain=UCF1012022.04 | 32 | 60.8 | 72.2 | 81.7 | — | |
| CoCLR-2StreamTraining Dataset=UCF101, Modality=Two-stream, Averaged similarity=true2020.10 | 26.1 | 45.8 | 57.9 | 69.7 | — | |
| MCNBackbone=R3D-18 (20.2M), Pretrain=UCF101, additional residual views=true2022.04 | 24.1 | 46.8 | 59.7 | 74.2 | — | |
| MCN (R3D)Backbone=R3D2021.08 | 24.1 | 46.8 | 59.7 | 74.2 | 87.6 | |
| CoCLR-FlowTraining Dataset=UCF101, Modality=Flow2020.10 | 23.9 | 47.3 | 58.3 | 69.3 | — | |
| MCN (R(2+1)D)Backbone=R(2+1)D2021.08 | 23.7 | 46.5 | 58.9 | 72.4 | 87.3 | |
| CoCLR-RGBTraining Dataset=UCF101, Modality=RGB2020.10 | 23.2 | 43.2 | 53.5 | 65.5 | — | |
| COCLR2021.08 | 23.2 | 43.2 | 53.5 | 65.5 | — | |
| TCLRBackbone=R3D-18 (20.2M), Pretrain=UCF1012022.04 | 22.8 | 45.4 | 57.8 | 73.1 | — | |
| InfoNCE-FlowTraining Dataset=UCF101, Modality=Flow2020.10 | 21.4 | 46.3 | 59.6 | 72.1 | — | |
| MFOBackbone=R3D-18 (20.2M), Pretrain=K4002022.04 | 20.7 | 40.8 | 55.2 | 68.3 | — | |
| PCL (VCP)Backbone=R3D-182020.10 | 20.2 | 43.6 | 59.1 | 72.5 | 86.6 | |
| IIC2021.08 | 19.7 | 42.9 | 57.1 | 70.6 | 85.9 | |
| PCL (VCP)Backbone=C3D2020.10 | 19.6 | 41.5 | 44.8 | 70.2 | 85.9 | |
| PCL (VCP)Backbone=R(2+1)D2020.10 | 19.6 | 41.1 | 56.2 | 71.1 | 86.5 | |
| PCL (VCP)Backbone=R3D2020.10 | 19.2 | 42 | 55.3 | 69.1 | 86.7 | |
| MFOBackbone=R3D-18 (20.2M), Pretrain=UCF1012022.04 | 18.8 | 39.2 | 51 | 63.7 | — | |
| STSBackbone=R3D-18 (20.2M), Pretrain=UCF1012022.04 | 18 | 37.2 | 50.7 | 64.8 | — | |
| FedVSSLPre-training dataset=K400 (Non-IID), Alpha (α)=0, Beta (β)=12022.07 | 16.93 | 37.78 | — | — | — | |
| FedVSSLPre-training dataset=K400 (Non-IID), Alpha (α)=0.9, Beta (β)=12022.07 | 16.93 | 37.39 | — | — | — | |
| FedVSSLPre-training dataset=K400 (Non-IID), Alpha (α)=1, Beta (β)=02022.07 | 16.73 | 38.3 | — | — | — | |
| FedAvg (Baseline)Pre-training dataset=K400 (Non-IID)2022.07 | 16.54 | 35.29 | — | — | — | |
| FedVSSLPre-training dataset=K400 (Non-IID), Alpha (α)=1, Beta (β)=12022.07 | 16.41 | 36.93 | — | — | — | |
| FedVSSLPre-training dataset=K400 (Non-IID), Alpha (α)=0.9, Beta (β)=02022.07 | 16.27 | 37.25 | — | — | — | |
| FedVSSLPre-training dataset=K400 (Non-IID), Alpha (α)=0, Beta (β)=02022.07 | 15.82 | 36.01 | — | — | — | |
| MemDPC-FlowBackbone=R2D3D2020.10 | 15.6 | 37.6 | 52 | 65.3 | — | |
| IICBackbone=R3D-182020.10 | 15.5 | 34.4 | 48.9 | 63.8 | 83.8 | |
| InfoNCE-RGBTraining Dataset=UCF101, Modality=RGB2020.10 | 15.2 | 34.7 | 48.9 | 63.2 | — | |
| PCL (VCOP)Backbone=C3D2020.10 | 14.9 | 35.9 | 48.9 | 63.6 | 82.8 | |
| PCL (VCOP)Backbone=R3D2020.10 | 14.3 | 34 | 48.3 | 62.1 | 81.9 | |
| IICBackbone=R3D2020.10 | 13.4 | 32.7 | 46.7 | 61.5 | 83.8 | |
| PacePredBackbone=R(2+1)D2020.10 | 12.9 | 31.6 | 43.2 | 58 | 77.1 | |
| IICBackbone=R(2+1)D2020.10 | 12.7 | 33.3 | 45.8 | 61.6 | 81.3 | |
| PacePredBackbone=C3D2020.10 | 12.5 | 32.2 | 45.4 | 61 | 80.7 | |
| PP2021.08 | 12.5 | 32.2 | 45.4 | 61 | 80.7 | |
| PCL (3DRotNet)Backbone=R3D-182020.10 | 12.4 | 34.4 | 48.4 | 65.4 | 83.6 | |
| Catch-the-PatchPre-training Dataset=Kinetics-400, Backbone=R3D-182021.05 | 11.8 | 30.1 | — | — | — | |
| CentralizedPre-training dataset=K400 (Non-IID)2022.07 | 11.8 | 30.1 | — | — | — | |
| IICBackbone=C3D2020.10 | 11.5 | 31.3 | 43.9 | 60.1 | 80.3 | |
| Catch-the-PatchPre-training Dataset=UCF-101, Backbone=R3D-182021.05 | 11.4 | 30.2 | — | — | — | |
| VCPBackbone=R3D-182020.10 | 10.9 | 25.2 | 36.8 | 51.5 | 71.8 | |
| PRPBackbone=C3D2020.10 | 10.5 | 27.2 | 40.4 | 56.2 | 75.9 | |
| CMC2021.08 | 10.2 | 25.3 | 36.6 | 51.6 | 74.3 | |
| PacePredBackbone=R3D-182020.10 | 9.6 | 26.9 | 41.1 | 56.1 | 76.5 | |
| PaceBackbone=R3D-18 (20.2M), Pretrain=UCF1012022.04 | 9.6 | 26.9 | 41.1 | 56.1 | — | |
| PRPBackbone=R3D2020.10 | 8.2 | 25.8 | 38.5 | 63.3 | 75.9 | |
| PRPBackbone=R(2+1)D2020.10 | 8.2 | 25.3 | 36.2 | 51 | 73 | |
| PRPPre-training Dataset=UCF-101, Backbone=R3D-182021.05 | 8.2 | 25.8 | — | — | — | |
| PacePre-training Dataset=UCF-101, Backbone=R3D-182021.05 | 8.2 | 24.2 | — | — | — | |
| PRPBackbone=R3D-18 (20.2M), Pretrain=UCF1012022.04 | 8.2 | 25.8 | 38.5 | 53.3 | — | |
| PCL (VCOP)Backbone=R(2+1)D2020.10 | 7.9 | 23.8 | 35.9 | 51 | 74.7 | |
| VCPBackbone=C3D2020.10 | 7.8 | 23.8 | 35.3 | 49.3 | 71.6 | |
| MemDPCDate=2020, Training Dataset=UCF1012020.10 | 7.7 | 25.7 | 40.6 | 57.7 | — | |
| MemDPCBackbone=R2D3D2020.10 | 7.7 | 25.7 | 40.6 | 57.7 | — | |
| VCOPDate=2019, Training Dataset=UCF1012020.10 | 7.6 | 22.9 | 34.4 | 48.8 | — | |
| VCPDate=2020, Training Dataset=UCF1012020.10 | 7.6 | 24.4 | 36.3 | 53.6 | — | |
| VCOPBackbone=R3D2020.10 | 7.6 | 22.9 | 34.4 | 48.8 | 68.9 | |
| VCPBackbone=R3D2020.10 | 7.6 | 24.4 | 36.3 | 53.6 | 76.4 | |
| VCOPPre-training Dataset=UCF-101, Backbone=R3D-182021.05 | 7.6 | 22.9 | — | — | — | |
| VCPPre-training Dataset=UCF-101, Backbone=R3D-182021.05 | 7.6 | 24.4 | — | — | — | |
| VCPBackbone=R3D-18 (20.2M), Pretrain=UCF1012022.04 | 7.6 | 24.4 | 36.3 | 53.6 | — | |
| DSMBackbone=I3D (25.0M), Pretrain=UCF1012022.04 | 7.6 | 23.3 | 36.5 | 52.5 | — | |
| VCOP2021.08 | 7.6 | 22.9 | 34.4 | 48.8 | 68.9 | |
| VCP2021.08 | 7.6 | 24.4 | 36.3 | 53.6 | 76.4 | |
| RandomBackbone=C3D2020.10 | 7.4 | 20.5 | 31.9 | 44.5 | 66.3 | |
| VCOPBackbone=C3D2020.10 | 7.4 | 22.6 | 34.4 | 48.5 | 70.1 | |
| RandomBackbone=R3D-182020.10 | 7.1 | 19.3 | 29.6 | 44.2 | 68.6 | |
| RandomBackbone=R3D2020.10 | 6.7 | 18.3 | 28.3 | 43.1 | 67.9 | |
| VCPBackbone=R(2+1)D2020.10 | 6.7 | 21.3 | 32.7 | 49.2 | 73.3 | |
| 3DRotNetBackbone=R3D-182020.10 | 6.2 | 18.7 | 31 | 46.6 | 70.5 | |
| VCOPBackbone=R(2+1)D2020.10 | 5.7 | 19.5 | 30.7 | 45.6 | 67 | |
| RandomBackbone=R(2+1)D2020.10 | 4.5 | 14.8 | 23.4 | 38.9 | 63 |