Few-shot Video Recognition on Something-Something V2 (K=2, 4, 8, 16)
9.1Top-1 Acc (K=2)Zero-ViCLIP + MSTA + Lcc
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Zero-ViCLIP + MSTA + LccGFLOPs=179.84, Transfer learning protocol=Efficient transfer pre-trained models, Multi-view inference=true2024.11 | 9.1 | 10.4 | 13.4 | 17.5 | |
| Zero-ViCLIP + MSTAGFLOPs=179.84, Transfer learning protocol=Efficient transfer pre-trained models, Multi-view inference=true2024.11 | 9 | 10.1 | 12.7 | 16.6 | |
| ViCLIPGFLOPs=161, Transfer learning protocol=Tuning pre-trained models, Multi-view inference=true2024.11 | 8.7 | 9.7 | 11.6 | 15.4 | |
| Zero-ViCLIP + AdaptFormerGFLOPs=179.80, Transfer learning protocol=Efficient transfer pre-trained models, Multi-view inference=true2024.11 | 8.5 | 10.1 | 11.5 | 15.2 | |
| Zero-ViCLIP + LORAGFLOPs=179.80, Transfer learning protocol=Efficient transfer pre-trained models, Multi-view inference=true2024.11 | 8.4 | 9.5 | 11.1 | 14.9 | |
| MOTEGFLOPs=141, Transfer learning protocol=Tuning pre-trained models, Multi-view inference=true2024.11 | 7.4 | 8.7 | 9.8 | 12.5 | |
| OSTTransfer learning protocol=Tuning pre-trained models, Multi-view inference=true2024.11 | 7.3 | 8.4 | 8.5 | 11.5 | |
| Vanilla CLIPGFLOPs=282, Transfer learning protocol=Tuning pre-trained models, Multi-view inference=true2024.11 | 6.7 | 7.3 | 9 | 12.2 | |
| ViFi-CLIPGFLOPs=281, Transfer learning protocol=Tuning pre-trained models, Multi-view inference=true2024.11 | 6.5 | 7.7 | 8.3 | 12.9 | |
| Zero-ViCLIPGFLOPs=161, Transfer learning protocol=Efficient transfer pre-trained models, Multi-view inference=true2024.11 | 5.1 | 5.1 | 5.1 | 5.1 | |
| A5GFLOPs=284, Transfer learning protocol=Adapting pre-trained models, Multi-view inference=true2024.11 | 4.5 | 5.3 | 6.3 | 9.9 | |
| XCLIPGFLOPs=145, Transfer learning protocol=Adapting pre-trained models, Multi-view inference=true2024.11 | 4.4 | 5.2 | 6.6 | 11.1 | |
| Vanilla CLIPGFLOPs=281, Transfer learning protocol=Zero-shot pre-trained models, Multi-view inference=true2024.11 | 2.8 | 2.8 | 2.8 | 2.8 |