Zero-shot Evaluation on StableEval 27 evals
70.9Average PerformanceACED-F2
Evaluation Results
| Method | Links | |
|---|---|---|
| ACED-F2Samples Seen=13B, Inference GFlops=10.29, Zero-shot=true2024.11 | 70.9 | |
| MobileCLIP-S2Samples Seen=13B, Inference GFlops=10.81, Zero-shot=true2024.11 | 69.8 | |
| ACED-F1Samples Seen=13B, Inference GFlops=7.14, Zero-shot=true2024.11 | 69.7 | |
| MobileCLIP-S1Samples Seen=13B, Inference GFlops=7.64, Zero-shot=true2024.11 | 67.9 | |
| DataComp-CLIP-B/32Samples Seen=13B, Inference GFlops=7.39, Zero-shot=true2024.11 | 64.6 | |
| ACED-F0Samples Seen=13B, Inference GFlops=3.3, Zero-shot=true2024.11 | 64 | |
| MetaCLIP-CLIP-B/32Samples Seen=13B, Inference GFlops=7.39, Zero-shot=true2024.11 | 63.9 | |
| LAION-CLIP-B/32Samples Seen=34B, Inference GFlops=7.39, Zero-shot=true2024.11 | 63.7 | |
| MobileCLIP-S0Samples Seen=13B, Inference GFlops=3.7, Zero-shot=true2024.11 | 63.6 | |
| TinyCLIP-63M/32Samples Seen=15.8B, Inference GFlops=5.65, Zero-shot=true2024.11 | 62.1 | |
| TinyCLIP-45M/32Samples Seen=15.8B, Inference GFlops=3.7, Zero-shot=true2024.11 | 60.4 | |
| TinyCLIP-39M/16Samples Seen=20B, Inference GFlops=9.48, Zero-shot=true2024.11 | 59.5 | |
| OpenAI-CLIP-B/32Samples Seen=13B, Inference GFlops=7.39, Zero-shot=true2024.11 | 58.6 | |
| DatologyAI-cls-B/32Samples Seen=5.1B, Inference GFlops=7.39, Zero-shot=true2024.11 | 58.5 | |
| DatologyAI-ret-B/32Samples Seen=5.1B, Inference GFlops=7.39, Zero-shot=true2024.11 | 57.3 | |
| TinyCLIP-RN30MSamples Seen=15.2B, Inference GFlops=6.93, Zero-shot=true2024.11 | 56.6 | |
| OpenAI-RN101Samples Seen=13B, Inference GFlops=12.75, Zero-shot=true2024.11 | 56.5 | |
| OpenAI-RN50Samples Seen=13B, Inference GFlops=9.09, Zero-shot=true2024.11 | 53.6 | |
| CLIP-KD-RN50Samples Seen=0.5B, Inference GFlops=9.09, Zero-shot=true2024.11 | 52.2 | |
| DatologyAI-cls-S/32Samples Seen=2.0B, Inference GFlops=2.83, Zero-shot=true2024.11 | 50.5 | |
| DatologyAI-ret-S/32Samples Seen=2.0B, Inference GFlops=2.83, Zero-shot=true2024.11 | 49.3 |