CLIP Evaluation Suite
Benchmarks
TaskDatasetSOTA resultTrendResults
20-task CLIP evaluation suite (test)
76.61SUN Accuracy
20
CLIP Evaluation Suite IN-1K, Caltech, Pets, Cars, Flowers, Food, Aircraft, SUN, DTD, ESAT, UCF
64.7Accuracy (IN-1K)
13
CLIP Evaluation Suite v1 (test)
46.5Food101 Accuracy
6
CLIP Evaluation Suite OxfordPets, Flowers102, FGVCAircraft, DTD, EuroSAT, StanfordCars, SUN397, Caltech101, UCF101 (test)
36.96OxfordPets Accuracy
2