Action Phase Classification on COIN
54.1Phase AccTimeSformer (Distant Supervision)
Evaluation Results
| Method | Links | |
|---|---|---|
| TimeSformer (Distant Supervision)Segment Model=TimeSformer, Pretraining Supervision=Unsupervised: distant supervision (ours), Pretraining Dataset=HT100M, Evaluation Protocol=linear probing2022.01 | 54.1 | |
| Supervised LearningFraction of Labels=1.02021.11 | 49.18 | |
| TimeSformerSegment Model=TimeSformer, Pretraining Supervision=Supervised: action labels, Pretraining Dataset=Kinetics, Evaluation Protocol=linear probing2022.01 | 48.3 | |
| VAVAFraction of Labels=1.02021.11 | 47.26 | |
| TimeSformerSegment Model=TimeSformer, Pretraining Supervision=Unsupervised: k-means on ASR, Pretraining Dataset=HT100M, Evaluation Protocol=linear probing2022.01 | 46.5 | |
| VAVAFraction of Labels=0.52021.11 | 46.18 | |
| VAVAFraction of Labels=0.12021.11 | 43.77 | |
| Supervised LearningFraction of Labels=0.52021.11 | 40.73 | |
| TCCFraction of Labels=1.02021.11 | 40.66 | |
| TCNFraction of Labels=1.02021.11 | 40.51 | |
| SALFraction of Labels=1.02021.11 | 40.32 | |
| LAVFraction of Labels=1.02021.11 | 39.81 | |
| TCNFraction of Labels=0.52021.11 | 39.73 | |
| TCCFraction of Labels=0.52021.11 | 39.56 | |
| VideoCLIPSegment Model=VideoCLIP, Pretraining Supervision=Unsupervised: NCE on ASR, Pretraining Dataset=HT100M, Evaluation Protocol=linear probing2022.01 | 39.4 | |
| SALFraction of Labels=0.52021.11 | 39.23 | |
| LAVFraction of Labels=0.52021.11 | 38.85 | |
| S3DSegment Model=S3D, Pretraining Supervision=Unsupervised: MIL-NCE on ASR, Pretraining Dataset=HT100M, Evaluation Protocol=fine-tuning2022.01 | 37.5 | |
| Imagenet FeaturesFraction of Labels=1.02021.11 | 37.43 | |
| Supervised LearningFraction of Labels=0.12021.11 | 37.11 | |
| LAVFraction of Labels=0.12021.11 | 36.79 | |
| TSN (RGB+Flow)Segment Model=TSN (RGB+Flow), Pretraining Supervision=Supervised: action labels, Pretraining Dataset=Kinetics, Evaluation Protocol=fine-tuning2022.01 | 36.5 | |
| TCCFraction of Labels=0.12021.11 | 35.87 | |
| TCNFraction of Labels=0.12021.11 | 34.87 | |
| Imagenet FeaturesFraction of Labels=0.52021.11 | 34.74 | |
| SALFraction of Labels=0.12021.11 | 34.69 | |
| SlowFastSegment Model=SlowFast, Pretraining Supervision=Supervised: action labels, Pretraining Dataset=Kinetics, Evaluation Protocol=linear probing2022.01 | 32.9 | |
| Imagenet FeaturesFraction of Labels=0.12021.11 | 31.32 | |
| ClipBERTSegment Model=ClipBERT, Pretraining Supervision=Supervised: captions, Pretraining Dataset=COCO + Visual Genome, Evaluation Protocol=linear probing2022.01 | 30.8 | |
| Random FeaturesFraction of Labels=1.02021.11 | 30.38 | |
| Random FeaturesFraction of Labels=0.52021.11 | 30.29 | |
| Random FeaturesFraction of Labels=0.12021.11 | 29.5 |