# Robustness Evaluation on SI-Score location synthetic Source: [Robustness Evaluation on SI-Score location synthetic]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:59:23.771Z Evaluation of model robustness using SI-Score location synthetic data, measured by Rank-based metrics (R@1, R@5). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Robustness Evaluation | | Dataset (including any stated split) | SI-Score location synthetic | | Metric | R@1 | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 31 of 31 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [R@1](): Higher is better; unit: PERCENT. - [R@5](): Higher is better; unit: PERCENT. ## Recorded results | Method | R@1 | Result date | Report paper | | --- | --- | --- | --- | | RobustViT | 48.3 | Not recorded | 68fa6cb81e209131cea3591e | | RobustViT | 47.4 | Not recorded | 68fa6cb81e209131cea3591e | | RobustViT | 44.3 | Not recorded | 68fa6cb81e209131cea3591e | | Original | 43.8 | Not recorded | 68fa6cb81e209131cea3591e | | RobustViT | 43.2 | Not recorded | 68fa6cb81e209131cea3591e | | RRR | 42.4 | Not recorded | 68fa6cb81e209131cea3591e | | GradMask | 41.5 | Not recorded | 68fa6cb81e209131cea3591e | | Original | 40.5 | Not recorded | 68fa6cb81e209131cea3591e | | RobustViT | 38.6 | Not recorded | 68fa6cb81e209131cea3591e | | RobustViT | 38.4 | Not recorded | 68fa6cb81e209131cea3591e | | RobustViT | 37.8 | Not recorded | 68fa6cb81e209131cea3591e | | RobustViT | 36.8 | Not recorded | 68fa6cb81e209131cea3591e | | RobustViT | 36.7 | Not recorded | 68fa6cb81e209131cea3591e | | RobustViT | 36.6 | Not recorded | 68fa6cb81e209131cea3591e | | RobustViT | 36.3 | Not recorded | 68fa6cb81e209131cea3591e | | RobustViT | 36.3 | Not recorded | 68fa6cb81e209131cea3591e | | RRR | 35.6 | Not recorded | 68fa6cb81e209131cea3591e | | GradMask | 34.6 | Not recorded | 68fa6cb81e209131cea3591e | | Original | 34.5 | Not recorded | 68fa6cb81e209131cea3591e | | RRR | 34.4 | Not recorded | 68fa6cb81e209131cea3591e | | GradMask | 34.3 | Not recorded | 68fa6cb81e209131cea3591e | | GradMask | 34.1 | Not recorded | 68fa6cb81e209131cea3591e | | Original | 33.3 | Not recorded | 68fa6cb81e209131cea3591e | | RRR | 32.9 | Not recorded | 68fa6cb81e209131cea3591e | | RobustViT | 32.5 | Not recorded | 68fa6cb81e209131cea3591e | | Original | 32.4 | Not recorded | 68fa6cb81e209131cea3591e | | RobustViT | 32.3 | Not recorded | 68fa6cb81e209131cea3591e | | GradMask | 32 | Not recorded | 68fa6cb81e209131cea3591e | | RRR | 32 | Not recorded | 68fa6cb81e209131cea3591e | | Original | 31.6 | Not recorded | 68fa6cb81e209131cea3591e | | Original | 30.7 | Not recorded | 68fa6cb81e209131cea3591e | ### RobustViT R@1: 48.3. Result ID: 698f35bc3a6c314849f70789. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"AR-L","Annotated segmentation":true}. This record does not assert independent reproduction. ### RobustViT R@1: 47.4. Result ID: 698f35bc3a6c314849f7078a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"AR-L","Annotated segmentation":false}. This record does not assert independent reproduction. ### RobustViT R@1: 44.3. Result ID: 698f35bc3a6c314849f70787. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"AR-B","Annotated segmentation":false}. This record does not assert independent reproduction. ### Original R@1: 43.8. Result ID: 698f35bc3a6c314849f70788. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"AR-L","Annotated segmentation":false}. This record does not assert independent reproduction. ### RobustViT R@1: 43.2. Result ID: 698f35bc3a6c314849f70786. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"AR-B","Annotated segmentation":true}. This record does not assert independent reproduction. ### RRR R@1: 42.4. Result ID: 698f35bc3a6c314849f70785. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"AR-B","Annotated segmentation":true}. This record does not assert independent reproduction. ### GradMask R@1: 41.5. Result ID: 698f35bc3a6c314849f70784. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"AR-B","Annotated segmentation":true}. This record does not assert independent reproduction. ### Original R@1: 40.5. Result ID: 698f35bc3a6c314849f70783. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"AR-B","Annotated segmentation":false}. This record does not assert independent reproduction. ### RobustViT R@1: 38.6. Result ID: 698f35bc3a6c314849f70779. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ViT-B","Annotated segmentation":true}. This record does not assert independent reproduction. ### RobustViT R@1: 38.4. Result ID: 698f35bc3a6c314849f7077a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ViT-B","Annotated segmentation":false}. This record does not assert independent reproduction. ### RobustViT R@1: 37.8. Result ID: 698f35bc3a6c314849f70794. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"DeiT-B","Annotated segmentation":false}. This record does not assert independent reproduction. ### RobustViT R@1: 36.8. Result ID: 698f35bc3a6c314849f70781. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"AR-S","Annotated segmentation":true}. This record does not assert independent reproduction. ### RobustViT R@1: 36.7. Result ID: 698f35bc3a6c314849f7077d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ViT-L","Annotated segmentation":false}. This record does not assert independent reproduction. ### RobustViT R@1: 36.6. Result ID: 698f35bc3a6c314849f70793. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"DeiT-B","Annotated segmentation":true}. This record does not assert independent reproduction. ### RobustViT R@1: 36.3. Result ID: 698f35bc3a6c314849f7077c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ViT-L","Annotated segmentation":true}. This record does not assert independent reproduction. ### RobustViT R@1: 36.3. Result ID: 698f35bc3a6c314849f70782. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"AR-S","Annotated segmentation":false}. This record does not assert independent reproduction. ### RRR R@1: 35.6. Result ID: 698f35bc3a6c314849f70778. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"ViT-B","Annotated segmentation":true}. This record does not assert independent reproduction. ### GradMask R@1: 34.6. Result ID: 698f35bc3a6c314849f70777. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"ViT-B","Annotated segmentation":true}. This record does not assert independent reproduction. ### Original R@1: 34.5. Result ID: 698f35bc3a6c314849f70790. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DeiT-B","Annotated segmentation":false}. This record does not assert independent reproduction. ### RRR R@1: 34.4. Result ID: 698f35bc3a6c314849f70792. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeiT-B","Annotated segmentation":true}. This record does not assert independent reproduction. ### GradMask R@1: 34.3. Result ID: 698f35bc3a6c314849f7077f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"AR-S","Annotated segmentation":true}. This record does not assert independent reproduction. ### GradMask R@1: 34.1. Result ID: 698f35bc3a6c314849f70791. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeiT-B","Annotated segmentation":true}. This record does not assert independent reproduction. ### Original R@1: 33.3. Result ID: 698f35bc3a6c314849f70776. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"ViT-B","Annotated segmentation":false}. This record does not assert independent reproduction. ### RRR R@1: 32.9. Result ID: 698f35bc3a6c314849f70780. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"AR-S","Annotated segmentation":true}. This record does not assert independent reproduction. ### RobustViT R@1: 32.5. Result ID: 698f35bc3a6c314849f7078f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"DeiT-S","Annotated segmentation":false}. This record does not assert independent reproduction. ### Original R@1: 32.4. Result ID: 698f35bc3a6c314849f7077e. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"AR-S","Annotated segmentation":false}. This record does not assert independent reproduction. ### RobustViT R@1: 32.3. Result ID: 698f35bc3a6c314849f7078e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"DeiT-S","Annotated segmentation":true}. This record does not assert independent reproduction. ### GradMask R@1: 32. Result ID: 698f35bc3a6c314849f7078c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeiT-S","Annotated segmentation":true}. This record does not assert independent reproduction. ### RRR R@1: 32. Result ID: 698f35bc3a6c314849f7078d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeiT-S","Annotated segmentation":true}. This record does not assert independent reproduction. ### Original R@1: 31.6. Result ID: 698f35bc3a6c314849f7077b. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"ViT-L","Annotated segmentation":false}. This record does not assert independent reproduction. ### Original R@1: 30.7. Result ID: 698f35bc3a6c314849f7078b. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DeiT-S","Annotated segmentation":false}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.