Snitch Localization on CATER (test)
79.7Top-1 AccuracyTFC V3D Depthwise
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| TFC V3D DepthwiseBackbone=ResNet50, total frames=1 × 32 × 1, parameters=24.64M, GFLOPs=1322022.03 | 79.7 | 95.5 | 0.47 | |
| TFC V3DBackbone=ResNet50, total frames=1 × 32 × 1, parameters=32.68M, GFLOPs=1682022.03 | 79.5 | 94 | 0.5 | |
| V3DBackbone=ResNet50, total frames=1 × 32 × 1, parameters=31.63M, GFLOPs=167.72022.03 | 77.9 | 94 | 0.54 | |
| OPNetBackbone=OPNet, total frames=all frames, extra annotation/data=LA-CATER(Shamsian et al., 2020)2022.03 | 74.8 | — | 0.54 | |
| Hopper-multihopFPS=1, # Frames=132021.03 | 73.2 | 93.8 | 0.0085 | |
| HopperBackbone=Transformer, total frames=all frames, extra annotation/data=LA-CATER(Shamsian et al., 2020)2022.03 | 73.2 | 93.8 | 0.85 | |
| OC-SlotSSMPre-train=Enabled2024.06 | 69.27 | 90.48 | — | |
| Hopper-sinetFPS=1, # Frames=132021.03 | 69.1 | 91.8 | 0.0102 | |
| TPN-101FPS=2.5, # Frames=322021.03 | 65.3 | 83 | 0.0109 | |
| Hopper-transformerFPS=1, # Frames=132021.03 | 64.9 | 90.1 | 0.0111 | |
| TSM-50FPS=1, # Frames=132021.03 | 64 | 85.7 | 0.0093 | |
| OC-SlotSSMPre-train=None2024.06 | 61.58 | 84 | — | |
| Hopper-transformer (last frame)FPS=1, # Frames=132021.03 | 61.1 | 86.6 | 0.0142 | |
| I3D-50 + LSTMFPS=5, # Frames=642021.03 | 60.2 | 81.8 | 0.012 | |
| R3D+LSTMBackbone=ResNet50, total frames=64 × 10 × 12022.03 | 60.2 | 81.8 | 1.2 | |
| I3D-50FPS=5, # Frames=642021.03 | 57.4 | 78.4 | 0.014 | |
| R3DBackbone=ResNet50, total frames=64 × 10 × 32022.03 | 57.4 | 78.4 | 1.4 | |
| SlotSSMPre-train=Enabled2024.06 | 54.73 | 74.42 | — | |
| SlotTransformerPre-train=Enabled2024.06 | 49.21 | 70.24 | — | |
| V4DBackbone=ResNet50, total frames=8 × 10 × 3, parameters=36.42M, GFLOPs=9342022.03 | 47.2 | 72.1 | — | |
| I3D-50 + NL + LSTMFPS=2.5, # Frames=322021.03 | 46.2 | 69.9 | 0.015 | |
| R3D+NL+LSTMBackbone=ResNet50, total frames=32 × 10 × 12022.03 | 46.2 | 69.9 | 1.5 | |
| Hungarian (Tracking - ours)2021.03 | 46 | 52.7 | 0.019 | |
| Single State SSMPre-train=Enabled2024.06 | 41.15 | 65.7 | — | |
| SlotTransformerPre-train=None2024.06 | 41.09 | 62.24 | — | |
| DaSiamRPN (Tracking)2021.03 | 33.9 | 40.8 | 0.024 | |
| TrackingBackbone=SiamRPN, total frames=all frames2022.03 | 33.9 | — | 2.4 | |
| I3D-50 + NLFPS=2.5, # Frames=322021.03 | 26.7 | 68.9 | 0.026 | |
| R3D+NLBackbone=ResNet50, total frames=32 × 10 × 32022.03 | 26.7 | 68.9 | 2.6 | |
| SlotSSMPre-train=None2024.06 | 25.64 | 45.03 | — | |
| TSN (RGB) + LSTMFPS=3, # Frames=32021.03 | 25.6 | 67.2 | 0.026 | |
| SINetFPS=1, # Frames=132021.03 | 21.1 | 47.1 | 0.0314 | |
| TSN (RGB)FPS=3, # Frames=32021.03 | 14.1 | 38.5 | 0.032 | |
| TSN (Flow) + LSTMFPS=3, # Frames=32021.03 | 14 | 43.5 | 0.032 | |
| TransformerFPS=1, # Frames=132021.03 | 13.7 | 39.9 | 0.0353 | |
| Single State SSMPre-train=None2024.06 | 10.27 | 27.21 | — | |
| TSN (Flow)FPS=3, # Frames=32021.03 | 9.6 | 32.3 | 0.037 | |
| Random2021.03 | 2.8 | 13.8 | 0.039 |