Zero-shot Image Classification on ImageNet-1K
80.5Top-1 AccuracySigLIP ViT-L/16-res256
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SigLIP ViT-L/16-res256Backbone=ViT-L/16, Input Resolution=256x2562026.03 | 80.5 | — | |
| EUPE-ViT-BBackbone=ViT-B, Evaluation Protocol=Zero-shot2026.03 | 79.7 | — | |
| CLIP-A (ViT-L/14)Backbone=ViT-L/142026.03 | 79.6 | — | |
| SigLIP2-ViT-B/16Backbone=ViT-B/162026.03 | 78.5 | — | |
| PEcore-BBackbone=ViT-B, Evaluation Protocol=Zero-shot2026.03 | 78.4 | — | |
| SigLIP2-BBackbone=ViT-B, Evaluation Protocol=Zero-shot2026.03 | 78.2 | — | |
| CLIPS (ViT-L/14)Backbone=ViT-L/142026.03 | 76.8 | — | |
| RADIOv2.5-BBackbone=ViT-B, Evaluation Protocol=Zero-shot2026.03 | 74.6 | — | |
| C^2LIPBackbone=ViT-B/162026.03 | 73.5 | — | |
| DynamiCSDataset (Data Size)=DataComp-DFN (130M), Samples Seen@Resolution=1.28B@112 + 128M@224, GPU-hours=1632026.04 | 71.3 | — | |
| Full PrecisionModel=RN50x16, Bit-width (W/A)=FP2025.11 | 70.7 | — | |
| HQ-CLIPDataset (Data Size)=DataComp-DFN (130M), Samples Seen@Resolution=3.20B@224, GPU-hours=≈ 26752026.04 | 70.6 | — | |
| RG-TTABackbone=ViT-B/162026.07 | 70.35 | 93 | |
| RG-TTABackbone=ViT-B/322026.07 | 69.74 | 92.34 | |
| WhatIfDataset (Data Size)=Recap-DataComp-1B (1.4B), Samples Seen@Resolution=2.56B@112 + 128M@2242026.04 | 69.2 | — | |
| DynamiCSDataset (Data Size)=DataComp-DFN (130M), Samples Seen@Resolution=0.64B@112 + 128M@224, GPU-hours=952026.04 | 69.2 | — | |
| DFN*Dataset (Data Size)=DataComp-DFN (130M), Samples Seen@Resolution=1.28B@112 + 128M@224, GPU-hours=1512026.04 | 68.7 | — | |
| Original CLIPBackbone=ViT-B/162026.07 | 68.31 | 91.83 | |
| Full PrecisionModel=VB16, Bit-width (W/A)=FP2025.11 | 68.3 | — | |
| Joint V-LBackbone=ViT-B/162026.07 | 68.07 | 91.64 | |
| DFNDataset (Data Size)=DataComp-DFN (130M), Samples Seen@Resolution=1.28B@224, GPU-hours=≈ 10702026.04 | 67.8 | — | |
| CLIP-clipBackbone=ViT-B/162026.07 | 67.74 | 91.48 | |
| DynamiCSDataset (Data Size)=LAION-400M (298M), Samples Seen@Resolution=2.56B@112 + 128M@224, GPU-hours=2992026.04 | 67.5 | — | |
| Biased-promptsBackbone=ViT-B/162026.07 | 67 | 90.72 | |
| DynamiCSDataset (Data Size)=LAION-400M (298M), Samples Seen@Resolution=1.28B@112 + 128M@224, GPU-hours=1632026.04 | 65 | — | |
| D4CModel=RN50x16, Bit-width (W/A)=W8A82025.11 | 64.8 | — | |
| OpenCLIPDataset (Data Size)=LAION-400M (400M), Samples Seen@Resolution=2.56B@224, GPU-hours=21402026.04 | 64.2 | — | |
| Original CLIPBackbone=ViT-B/322026.07 | 63.39 | 88.83 | |
| Full PrecisionModel=VB32, Bit-width (W/A)=FP2025.11 | 63.3 | — | |
| CLIPA*Dataset (Data Size)=LAION-400M (298M), Samples Seen@Resolution=2.56B@112 + 128M@224, GPU-hours=2692026.04 | 63.2 | — | |
| DataCompDataset (Data Size)=DataComp (1.28B), Samples Seen@Resolution=1.28B@224, GPU-hours=≈ 10702026.04 | 63.1 | — | |
| Joint V-LBackbone=ViT-B/322026.07 | 63.01 | 88.56 | |
| BNS&PSEModel=RN50x16, Bit-width (W/A)=W8A82025.11 | 63 | — | |
| RECLIP*Dataset (Data Size)=LAION-400M (298M), Samples Seen@Resolution=2.56B@112 + 128M@224, GPU-hours=2802026.04 | 62.9 | — | |
| CLIP-clipBackbone=ViT-B/322026.07 | 62.9 | 88.32 | |
| RealModel=RN50x16, Bit-width (W/A)=W8A82025.11 | 62.8 | — | |
| GaussianModel=RN50x16, Bit-width (W/A)=W8A82025.11 | 62 | — | |
| Biased-promptsBackbone=ViT-B/322026.07 | 61.8 | 87.46 | |
| FLIPDataset (Data Size)=LAION-400M (400M), Samples Seen@Resolution=2.56B@224 + 128M@2242026.04 | 60.9 | — | |
| RealModel=RN50x16, Bit-width (W/A)=W4A82025.11 | 60.8 | — | |
| D4CModel=RN50x16, Bit-width (W/A)=W4A82025.11 | 60.4 | — | |
| Full PrecisionModel=RN50, Bit-width (W/A)=FP2025.11 | 59.8 | — | |
| CaptioningDataset (Data Size)=DataComp (1.28B), Samples Seen@Resolution=2.56B@224, GPU-hours=≈ 21402026.04 | 59.8 | — | |
| RealModel=RN50x16, Bit-width (W/A)=W6A62025.11 | 59 | — | |
| D4CModel=RN50x16, Bit-width (W/A)=W6A62025.11 | 58.7 | — | |
| BNS&PSEModel=RN50x16, Bit-width (W/A)=W6A62025.11 | 58.6 | — | |
| BNS&PSEModel=RN50x16, Bit-width (W/A)=W4A82025.11 | 58.5 | — | |
| D4CModel=VB16, Bit-width (W/A)=W8A82025.11 | 57.9 | — | |
| FLAVABackbone=ViT-B2026.03 | 56.9 | — | |
| RealModel=VB16, Bit-width (W/A)=W8A82025.11 | 56.4 | — | |
| BNS&PSEModel=VB16, Bit-width (W/A)=W8A82025.11 | 56.1 | — | |
| GaussianModel=RN50x16, Bit-width (W/A)=W6A62025.11 | 55.2 | — | |
| GaussianModel=RN50x16, Bit-width (W/A)=W4A82025.11 | 55 | — | |
| RealModel=VB16, Bit-width (W/A)=W4A82025.11 | 52.7 | — | |
| D4CModel=VB32, Bit-width (W/A)=W8A82025.11 | 51.7 | — | |
| D4CModel=RN50, Bit-width (W/A)=W8A82025.11 | 51.1 | — | |
| RealModel=VB32, Bit-width (W/A)=W8A82025.11 | 50.4 | — | |
| D4CModel=VB16, Bit-width (W/A)=W4A82025.11 | 49.9 | — | |
| RealModel=RN50, Bit-width (W/A)=W8A82025.11 | 49.7 | — | |
| GaussianModel=RN50, Bit-width (W/A)=W8A82025.11 | 49.5 | — | |
| BLIP-BBackbone=ViT-B2026.03 | 49.2 | — | |
| BNS&PSEModel=RN50, Bit-width (W/A)=W8A82025.11 | 49.1 | — | |
| GaussianModel=VB16, Bit-width (W/A)=W8A82025.11 | 49 | — | |
| RealModel=VB32, Bit-width (W/A)=W6A62025.11 | 48.1 | — | |
| D4CModel=RN50, Bit-width (W/A)=W6A62025.11 | 47.9 | — | |
| RealModel=VB32, Bit-width (W/A)=W4A82025.11 | 47.6 | — | |
| BNS&PSEModel=VB32, Bit-width (W/A)=W8A82025.11 | 47.6 | — | |
| BNS&PSEModel=VB16, Bit-width (W/A)=W4A82025.11 | 47 | — | |
| D4CModel=VB32, Bit-width (W/A)=W4A82025.11 | 46.1 | — | |
| D4CModel=VB32, Bit-width (W/A)=W6A62025.11 | 46.1 | — | |
| RealModel=RN50, Bit-width (W/A)=W6A62025.11 | 45.5 | — | |
| RealModel=VB16, Bit-width (W/A)=W6A62025.11 | 45.3 | — | |
| RealModel=RN50, Bit-width (W/A)=W4A82025.11 | 44.9 | — | |
| D4CModel=RN50, Bit-width (W/A)=W4A82025.11 | 44.3 | — | |
| BNS&PSEModel=RN50, Bit-width (W/A)=W6A62025.11 | 44 | — | |
| BNS&PSEModel=RN50, Bit-width (W/A)=W4A82025.11 | 42.9 | — | |
| BNS&PSEModel=VB32, Bit-width (W/A)=W6A62025.11 | 42.9 | — | |
| BNS&PSEModel=VB32, Bit-width (W/A)=W4A82025.11 | 40.4 | — | |
| GaussianModel=RN50, Bit-width (W/A)=W6A62025.11 | 39.5 | — | |
| D4CModel=VB16, Bit-width (W/A)=W6A62025.11 | 35.7 | — | |
| BenignModel=GPT-4o-mini2025.06 | 34.25 | — | |
| GaussianModel=VB32, Bit-width (W/A)=W8A82025.11 | 27.4 | — | |
| GaussianModel=RN50, Bit-width (W/A)=W4A82025.11 | 26.4 | — | |
| BenignModel=GPT-4.12025.06 | 17.5 | — | |
| GaussianModel=VB32, Bit-width (W/A)=W6A62025.11 | 15.7 | — | |
| GaussianModel=VB16, Bit-width (W/A)=W4A82025.11 | 15.3 | — | |
| GaussianModel=VB32, Bit-width (W/A)=W4A82025.11 | 13.6 | — | |
| BNS&PSEModel=VB16, Bit-width (W/A)=W6A62025.11 | 10.5 | — | |
| BaselineModel=GPT-4o-mini2025.06 | 5 | — | |
| BaselineModel=GPT-4.12025.06 | 3 | — | |
| SCGAModel=GPT-4o-mini2025.06 | 1.25 | — | |
| SCGAModel=GPT-4.12025.06 | 1 | — | |
| GaussianModel=VB16, Bit-width (W/A)=W6A62025.11 | 0.8 | — | |
| Original CLIPBackbone=ViT-H/14, Biases=Gender2024.11 | 0.7795 | 0.9519 | |
| Original CLIPBackbone=ViT-H/14, Biases=Age2024.11 | 0.7795 | 0.9519 | |
| OursBackbone=ViT-H/14, Biases=Gender2024.11 | 0.7784 | 0.9517 | |
| OursBackbone=ViT-H/14, Biases=Age2024.11 | 0.7782 | 0.9519 | |
| CLIP-clipBackbone=ViT-H/14, Biases=Gender2024.11 | 0.7757 | 0.949 | |
| Biased-promptsBackbone=ViT-H/14, Biases=Gender2024.11 | 0.7753 | 0.95 | |
| CLIP-clipBackbone=ViT-H/14, Biases=Age2024.11 | 0.775 | 0.9503 |