# Snitch Localization on CATER-h (test) Source: [Snitch Localization on CATER-h (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:06:56.585Z Evaluation of Snitch Localization performance on the test split of the CATER-h dataset. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Snitch Localization | | Dataset (including any stated split) | CATER-h (test) | | Metric | Top-1 Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 28 of 28 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Top-1 Accuracy](): Higher is better; unit: PERCENT. - [Top-5 Accuracy](): Higher is better; unit: PERCENT. - [L1 Loss](): Lower is better; unit: SCALAR. ## Recorded results | Method | Top-1 Accuracy | Result date | Report paper | | --- | --- | --- | --- | | Hopper-multihop | 68.4 | Not recorded | 68fa698e1e209131cea22929 | | Hopper-multihop | 68.4 | Not recorded | 68fa698e1e209131cea22929 | | Hopper-multihop | 68.4 | Not recorded | 68fa698e1e209131cea22929 | | Hopper-sinet | 62.8 | Not recorded | 68fa698e1e209131cea22929 | | Hopper-sinet | 62.8 | Not recorded | 68fa698e1e209131cea22929 | | Hopper-sinet | 62.8 | Not recorded | 68fa698e1e209131cea22929 | | Hopper-transformer | 57.6 | Not recorded | 68fa698e1e209131cea22929 | | Hopper-transformer | 57.6 | Not recorded | 68fa698e1e209131cea22929 | | Hopper-transformer | 57.6 | Not recorded | 68fa698e1e209131cea22929 | | TPN-101 | 50.2 | Not recorded | 68fa698e1e209131cea22929 | | TPN-101 | 50.2 | Not recorded | 68fa698e1e209131cea22929 | | TSM-50 | 44 | Not recorded | 68fa698e1e209131cea22929 | | TSM-50 | 44 | Not recorded | 68fa698e1e209131cea22929 | | Hopper-transformer (last frame) | 41.8 | Not recorded | 68fa698e1e209131cea22929 | | Hopper-transformer (last frame) | 41.8 | Not recorded | 68fa698e1e209131cea22929 | | Hopper-transformer (last frame) | 41.8 | Not recorded | 68fa698e1e209131cea22929 | | Hungarian (Tracking) | 37.2 | Not recorded | 68fa698e1e209131cea22929 | | Hungarian (Tracking - ours) | 37.2 | Not recorded | 68fa698e1e209131cea22929 | | SINet | 18.6 | Not recorded | 68fa698e1e209131cea22929 | | SINet | 18.6 | Not recorded | 68fa698e1e209131cea22929 | | SINet | 18.6 | Not recorded | 68fa698e1e209131cea22929 | | DaSiamRPN (Tracking) | 17.1 | Not recorded | 68fa698e1e209131cea22929 | | DaSiamRPN (Tracking) | 17.1 | Not recorded | 68fa698e1e209131cea22929 | | Transformer | 11.6 | Not recorded | 68fa698e1e209131cea22929 | | Transformer | 11.6 | Not recorded | 68fa698e1e209131cea22929 | | Transformer | 11.6 | Not recorded | 68fa698e1e209131cea22929 | | Random | 2.4 | Not recorded | 68fa698e1e209131cea22929 | | Random | 2.4 | Not recorded | 68fa698e1e209131cea22929 | ### Hopper-multihop Top-1 Accuracy: 68.4. Result ID: 698db4e48b517eb433233a40. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"# Parameters (M)":"6.39","GFLOPs":"1.79"}. This record does not assert independent reproduction. ### Hopper-multihop Top-1 Accuracy: 68.4. Result ID: 698db4e48b517eb433233a4b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"FPS":1,"# Frames":13}. This record does not assert independent reproduction. ### Hopper-multihop Top-1 Accuracy: 68.4. Result ID: 698db4e48b517eb433233a69. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"FPS":1,"# Frames":13}. This record does not assert independent reproduction. ### Hopper-sinet Top-1 Accuracy: 62.8. Result ID: 698db4e48b517eb433233a3f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"# Parameters (M)":"139.22","GFLOPs":"8.05"}. This record does not assert independent reproduction. ### Hopper-sinet Top-1 Accuracy: 62.8. Result ID: 698db4e48b517eb433233a4a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"FPS":1,"# Frames":13}. This record does not assert independent reproduction. ### Hopper-sinet Top-1 Accuracy: 62.8. Result ID: 698db4e48b517eb433233a68. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"FPS":1,"# Frames":13}. This record does not assert independent reproduction. ### Hopper-transformer Top-1 Accuracy: 57.6. Result ID: 698db4e48b517eb433233a3e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"# Parameters (M)":"15.01","GFLOPs":"1.10"}. This record does not assert independent reproduction. ### Hopper-transformer Top-1 Accuracy: 57.6. Result ID: 698db4e48b517eb433233a49. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"FPS":1,"# Frames":13}. This record does not assert independent reproduction. ### Hopper-transformer Top-1 Accuracy: 57.6. Result ID: 698db4e48b517eb433233a67. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"FPS":1,"# Frames":13}. This record does not assert independent reproduction. ### TPN-101 Top-1 Accuracy: 50.2. Result ID: 698db4e48b517eb433233a44. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"FPS":2.5,"# Frames":32}. This record does not assert independent reproduction. ### TPN-101 Top-1 Accuracy: 50.2. Result ID: 698db4e48b517eb433233a62. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"FPS":2.5,"# Frames":32}. This record does not assert independent reproduction. ### TSM-50 Top-1 Accuracy: 44. Result ID: 698db4e48b517eb433233a45. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"FPS":1,"# Frames":13}. This record does not assert independent reproduction. ### TSM-50 Top-1 Accuracy: 44. Result ID: 698db4e48b517eb433233a63. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"FPS":1,"# Frames":13}. This record does not assert independent reproduction. ### Hopper-transformer (last frame) Top-1 Accuracy: 41.8. Result ID: 698db4e48b517eb433233a3d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"# Parameters (M)":"15.01","GFLOPs":"0.09"}. This record does not assert independent reproduction. ### Hopper-transformer (last frame) Top-1 Accuracy: 41.8. Result ID: 698db4e48b517eb433233a48. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"FPS":1,"# Frames":13}. This record does not assert independent reproduction. ### Hopper-transformer (last frame) Top-1 Accuracy: 41.8. Result ID: 698db4e48b517eb433233a66. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"FPS":1,"# Frames":13}. This record does not assert independent reproduction. ### Hungarian (Tracking) Top-1 Accuracy: 37.2. Result ID: 698db4e48b517eb433233a43. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"FPS":null,"# Frames":null}. This record does not assert independent reproduction. ### Hungarian (Tracking - ours) Top-1 Accuracy: 37.2. Result ID: 698db4e48b517eb433233a61. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"FPS":null,"# Frames":null}. This record does not assert independent reproduction. ### SINet Top-1 Accuracy: 18.6. Result ID: 698db4e48b517eb433233a3b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"# Parameters (M)":"138.69","GFLOPs":"7.98"}. This record does not assert independent reproduction. ### SINet Top-1 Accuracy: 18.6. Result ID: 698db4e48b517eb433233a46. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":1,"# Frames":13}. This record does not assert independent reproduction. ### SINet Top-1 Accuracy: 18.6. Result ID: 698db4e48b517eb433233a64. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":1,"# Frames":13}. This record does not assert independent reproduction. ### DaSiamRPN (Tracking) Top-1 Accuracy: 17.1. Result ID: 698db4e48b517eb433233a42. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"FPS":null,"# Frames":null}. This record does not assert independent reproduction. ### DaSiamRPN (Tracking) Top-1 Accuracy: 17.1. Result ID: 698db4e48b517eb433233a60. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"FPS":null,"# Frames":null}. This record does not assert independent reproduction. ### Transformer Top-1 Accuracy: 11.6. Result ID: 698db4e48b517eb433233a3c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"# Parameters (M)":"15.01","GFLOPs":"0.11"}. This record does not assert independent reproduction. ### Transformer Top-1 Accuracy: 11.6. Result ID: 698db4e48b517eb433233a47. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"FPS":1,"# Frames":13}. This record does not assert independent reproduction. ### Transformer Top-1 Accuracy: 11.6. Result ID: 698db4e48b517eb433233a65. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"FPS":1,"# Frames":13}. This record does not assert independent reproduction. ### Random Top-1 Accuracy: 2.4. Result ID: 698db4e48b517eb433233a41. [Reporting paper]() Recorded evaluation configuration: {"FPS":null,"# Frames":null}. This record does not assert independent reproduction. ### Random Top-1 Accuracy: 2.4. Result ID: 698db4e48b517eb433233a5f. [Reporting paper]() Recorded evaluation configuration: {"FPS":null,"# Frames":null}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.