Robustness Evaluation on SI-Score size synthetic
66.5R@1RobustViT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RobustViTBackbone=AR-L, Annotated segmentation=false2022.06 | 66.5 | 85.6 | |
| RobustViTBackbone=AR-L, Annotated segmentation=true2022.06 | 66.4 | 86 | |
| RobustViTBackbone=AR-B, Annotated segmentation=false2022.06 | 64.5 | 84.6 | |
| RobustViTBackbone=AR-B, Annotated segmentation=true2022.06 | 64.1 | 83.9 | |
| OriginalBackbone=AR-L, Annotated segmentation=false2022.06 | 62.3 | 82.2 | |
| RRRBackbone=AR-B, Annotated segmentation=true2022.06 | 62.1 | 82 | |
| GradMaskBackbone=AR-B, Annotated segmentation=true2022.06 | 61.4 | 81.3 | |
| RobustViTBackbone=AR-S, Annotated segmentation=true2022.06 | 61.3 | 81.2 | |
| RobustViTBackbone=ViT-B, Annotated segmentation=true2022.06 | 61 | 81.4 | |
| RobustViTBackbone=AR-S, Annotated segmentation=false2022.06 | 60.7 | 80.4 | |
| OriginalBackbone=AR-B, Annotated segmentation=false2022.06 | 60.6 | 80.4 | |
| RobustViTBackbone=ViT-B, Annotated segmentation=false2022.06 | 60.2 | 80.6 | |
| RobustViTBackbone=DeiT-B, Annotated segmentation=false2022.06 | 59.3 | 79 | |
| RobustViTBackbone=ViT-L, Annotated segmentation=false2022.06 | 59.1 | 80.5 | |
| RobustViTBackbone=ViT-L, Annotated segmentation=true2022.06 | 58.6 | 80.3 | |
| RRRBackbone=ViT-B, Annotated segmentation=true2022.06 | 58 | 78.4 | |
| GradMaskBackbone=AR-S, Annotated segmentation=true2022.06 | 58 | 78.3 | |
| RobustViTBackbone=DeiT-B, Annotated segmentation=true2022.06 | 58 | 78.2 | |
| GradMaskBackbone=ViT-B, Annotated segmentation=true2022.06 | 57 | 77.5 | |
| RRRBackbone=AR-S, Annotated segmentation=true2022.06 | 56 | 76.3 | |
| RobustViTBackbone=DeiT-S, Annotated segmentation=false2022.06 | 56 | 76.1 | |
| RobustViTBackbone=DeiT-S, Annotated segmentation=true2022.06 | 55.8 | 76.3 | |
| OriginalBackbone=ViT-B, Annotated segmentation=false2022.06 | 55.6 | 76.2 | |
| OriginalBackbone=AR-S, Annotated segmentation=false2022.06 | 55.4 | 75.7 | |
| RRRBackbone=DeiT-B, Annotated segmentation=true2022.06 | 55.3 | 75.8 | |
| GradMaskBackbone=DeiT-B, Annotated segmentation=true2022.06 | 55.2 | 75.8 | |
| OriginalBackbone=ViT-L, Annotated segmentation=false2022.06 | 54.8 | 75.6 | |
| OriginalBackbone=DeiT-B, Annotated segmentation=false2022.06 | 54.6 | 73.4 | |
| GradMaskBackbone=DeiT-S, Annotated segmentation=true2022.06 | 54.1 | 74 | |
| RRRBackbone=DeiT-S, Annotated segmentation=true2022.06 | 53.9 | 73.8 | |
| OriginalBackbone=DeiT-S, Annotated segmentation=false2022.06 | 51.6 | 72 |