# Snitch Localization on CATER v1.0 (test) Source: [Snitch Localization on CATER v1.0 (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:06:59.937Z Evaluation of Snitch Localization performance on the test split of the CATER dataset, version 1.0. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Snitch Localization | | Dataset (including any stated split) | CATER Snitch localization 1.0 (test) | | Metric | Top-1 Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 17 of 17 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Top-1 Accuracy](): Higher is better; unit: PERCENT. - [Top-5 Accuracy](): Higher is better; unit: PERCENT. - [L1 Distance (grid)](): Lower is better; unit: SCALAR. - [L2 Distance](): Lower is better; unit: SCALAR. ## Recorded results | Method | Top-1 Accuracy | Result date | Report paper | | --- | --- | --- | --- | | Loci | 90.7 | Not recorded | 68fa6e801e209131cea40624 | | TFC V3D Depthwise | 79.7 | Not recorded | 68fa6e801e209131cea40624 | | Loci | 78.4 | Not recorded | 68fa6e801e209131cea40624 | | OPNet | 74.8 | Not recorded | 68fa6e801e209131cea40624 | | Aloe | 74 | Not recorded | 68fa6e801e209131cea40624 | | Hopper-multihop | 73.2 | Not recorded | 68fa6e801e209131cea40624 | | Inferno | 71.7 | Not recorded | 68fa6e801e209131cea40624 | | Hopper-sinet | 69.1 | Not recorded | 68fa6e801e209131cea40624 | | TPN-101 | 65.3 | Not recorded | 68fa6e801e209131cea40624 | | TSM-50 | 64 | Not recorded | 68fa6e801e209131cea40624 | | Hopper-transformer | 61.1 | Not recorded | 68fa6e801e209131cea40624 | | I3D-50 + LSTM | 60.2 | Not recorded | 68fa6e801e209131cea40624 | | DaSiamRPN | 33.9 | Not recorded | 68fa6e801e209131cea40624 | | TSN (RGB) + LSTM | 25.6 | Not recorded | 68fa6e801e209131cea40624 | | SINet | 21.1 | Not recorded | 68fa6e801e209131cea40624 | | Transformer | 13.7 | Not recorded | 68fa6e801e209131cea40624 | | Random | 2.8 | Not recorded | 68fa6e801e209131cea40624 | ### Loci Top-1 Accuracy: 90.7. Result ID: 699026913a6c314849fe78b2. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"supervision":"fine-tuned","Parameters (M)":"2.96"}. This record does not assert independent reproduction. ### TFC V3D Depthwise Top-1 Accuracy: 79.7. Result ID: 699026913a6c314849fe78b1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Parameters (M)":"24.64"}. This record does not assert independent reproduction. ### Loci Top-1 Accuracy: 78.4. Result ID: 699026913a6c314849fe78b3. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"supervision":"unsupervised","Parameters (M)":"4.14"}. This record does not assert independent reproduction. ### OPNet Top-1 Accuracy: 74.8. Result ID: 699026913a6c314849fe78b0. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Aloe Top-1 Accuracy: 74. Result ID: 699026913a6c314849fe78af. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Hopper-multihop Top-1 Accuracy: 73.2. Result ID: 699026913a6c314849fe78ae. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameters (M)":"6.39"}. This record does not assert independent reproduction. ### Inferno Top-1 Accuracy: 71.7. Result ID: 699026913a6c314849fe78ad. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Hopper-sinet Top-1 Accuracy: 69.1. Result ID: 699026913a6c314849fe78ac. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameters (M)":"139.22"}. This record does not assert independent reproduction. ### TPN-101 Top-1 Accuracy: 65.3. Result ID: 699026913a6c314849fe78ab. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### TSM-50 Top-1 Accuracy: 64. Result ID: 699026913a6c314849fe78aa. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Hopper-transformer Top-1 Accuracy: 61.1. Result ID: 699026913a6c314849fe78a9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameters (M)":"15.01"}. This record does not assert independent reproduction. ### I3D-50 + LSTM Top-1 Accuracy: 60.2. Result ID: 699026913a6c314849fe78a8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### DaSiamRPN Top-1 Accuracy: 33.9. Result ID: 699026913a6c314849fe78a7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### TSN (RGB) + LSTM Top-1 Accuracy: 25.6. Result ID: 699026913a6c314849fe78a6. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### SINet Top-1 Accuracy: 21.1. Result ID: 699026913a6c314849fe78a5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Parameters (M)":"138.69"}. This record does not assert independent reproduction. ### Transformer Top-1 Accuracy: 13.7. Result ID: 699026913a6c314849fe78a4. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameters (M)":"15.01"}. This record does not assert independent reproduction. ### Random Top-1 Accuracy: 2.8. Result ID: 699026913a6c314849fe78a3. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.