Zero-shot Image Classification on ImageNet-R (test)
89.9AccuracyREACT (Locked-Text Gated-Image)
Evaluation Results
| Method | Links | |
|---|---|---|
| REACT (Locked-Text Gated-Image)Backbone=ViT-L/14, Pretrain Data=WIT-400M, Evaluation Protocol=Zero-shot2023.01 | 89.9 | |
| REACT (Locked-Text Gated-Image)Backbone=ViT-L/14, Pretrain Data=LAION-2B, Evaluation Protocol=Zero-shot2023.01 | 89 | |
| CLIPBackbone=ViT-L/14, Pretrain Data=WIT-400M, Evaluation Protocol=Zero-shot2023.01 | 87.8 | |
| OpenCLIPBackbone=ViT-L/14, Pretrain Data=LAION-2B, Evaluation Protocol=Zero-shot2023.01 | 84.1 | |
| REACT (Locked-Text Gated-Image)Backbone=ViT-B/16, Pretrain Data=WIT-400M, Evaluation Protocol=Zero-shot2023.01 | 84 | |
| REACT (Locked-Text)Backbone=ViT-B/16, Pretrain Data=WIT-400M, Evaluation Protocol=Zero-shot2023.01 | 83.4 | |
| REACT (Locked-Text Gated-Image)Backbone=ViT-B/16, Pretrain Data=LAION-400M, Evaluation Protocol=Zero-shot2023.01 | 82.3 | |
| REACT (Locked-Text)Backbone=ViT-B/16, Pretrain Data=LAION-400M, Evaluation Protocol=Zero-shot2023.01 | 81.8 | |
| REACT (Locked-Text Gated-Image)Backbone=ViT-B/32, Pretrain Data=LAION-2B, Evaluation Protocol=Zero-shot2023.01 | 80.2 | |
| REACT (Locked-Text)Backbone=ViT-B/32, Pretrain Data=LAION-2B, Evaluation Protocol=Zero-shot2023.01 | 79.1 | |
| REACT (Locked-Text Gated-Image)Backbone=ViT-B/32, Pretrain Data=WIT-400M, Evaluation Protocol=Zero-shot2023.01 | 78.2 | |
| REACT (Locked-Text)Backbone=ViT-B/32, Pretrain Data=WIT-400M, Evaluation Protocol=Zero-shot2023.01 | 77.9 | |
| OpenCLIPBackbone=ViT-B/16, Pretrain Data=LAION-400M, Evaluation Protocol=Zero-shot2023.01 | 77.9 | |
| REACT (Locked-Text Gated-Image)Backbone=ViT-B/32, Pretrain Data=LAION-400M, Evaluation Protocol=Zero-shot2023.01 | 77.8 | |
| CLIPBackbone=ViT-B/16, Pretrain Data=WIT-400M, Evaluation Protocol=Zero-shot2023.01 | 77.6 | |
| REACT (Locked-Text)Backbone=ViT-B/32, Pretrain Data=LAION-400M, Evaluation Protocol=Zero-shot2023.01 | 77.5 | |
| OpenCLIPBackbone=ViT-B/32, Pretrain Data=LAION-2B, Evaluation Protocol=Zero-shot2023.01 | 76.5 | |
| OpenCLIPBackbone=ViT-B/32, Pretrain Data=LAION-400M, Evaluation Protocol=Zero-shot2023.01 | 73.4 | |
| CLIPBackbone=ViT-B/32, Pretrain Data=WIT-400M, Evaluation Protocol=Zero-shot2023.01 | 69.3 | |
| SAFT-LEvaluation Protocol=Clean2026.02 | 52.85 | |
| TGA-ZSREvaluation Protocol=Clean2026.02 | 46.74 | |
| SAFT-LEvaluation Protocol=Robust2026.02 | 29.7 | |
| TGA-ZSREvaluation Protocol=Robust2026.02 | 26.54 |