Image Classification on 11-Dataset Suite + ImageNet (Few-shot CLIP RN50)
89.97OxfordPets AccuracyCRoFT
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CRoFTBackbone=RN50, Pre-trained model=CLIP, shots=162024.05 | 89.97 | 84.54 | 93.27 | 67.26 | 38.85 | 95.66 | 78.43 | 79.44 | 71.9 | 76.09 | 65.2 | 76.42 | |
| Tip-Adapter-FBackbone=RN50, Pre-trained model=CLIP, shots=162024.05 | 89.7 | 84.54 | 92.86 | 66.55 | 35.55 | 94.8 | 78.03 | 79.43 | 71.47 | 75.74 | 65.51 | 75.83 | |
| CRoFTBackbone=RN50, Pre-trained model=CLIP, shots=82024.05 | 88.96 | 78.23 | 92.17 | 63.24 | 33.39 | 94.03 | 75.5 | 78.36 | 69.79 | 70.17 | 63.78 | 73.42 | |
| CRoFTBackbone=RN50, Pre-trained model=CLIP, shots=42024.05 | 88.28 | 75.15 | 91.44 | 59.34 | 27.06 | 91.47 | 71.72 | 78.35 | 68.05 | 66.61 | 62.88 | 70.94 | |
| Tip-AdapterBackbone=RN50, Pre-trained model=CLIP, shots=162024.05 | 88.14 | 70.54 | 90.18 | 60.93 | 29.76 | 89.89 | 70.58 | 77.83 | 66.85 | 66.77 | 62.01 | 70.32 | |
| Tip-Adapter-FBackbone=RN50, Pre-trained model=CLIP, shots=82024.05 | 88.09 | 77.93 | 91.44 | 62.71 | 30.21 | 91.51 | 74.25 | 78.64 | 68.87 | 69.25 | 64 | 72.45 | |
| AdapterBackbone=RN50, Pre-trained model=CLIP, shots=162024.05 | 87.84 | 84.43 | 92.49 | 65.96 | 32.1 | 93.9 | 76.76 | 78.25 | 69.55 | 74.01 | 63.59 | 74.44 | |
| AdapterBackbone=RN50, Pre-trained model=CLIP, shots=82024.05 | 87.65 | 77.93 | 91.4 | 61 | 26.25 | 91.72 | 73.3 | 78.04 | 67.5 | 67.89 | 62.68 | 71.4 | |
| Tip-Adapter-FBackbone=RN50, Pre-trained model=CLIP, shots=42024.05 | 87.54 | 74.12 | 90.56 | 57.39 | 25.8 | 88.83 | 70.55 | 78.24 | 66.21 | 64.57 | 62.52 | 69.67 | |
| AdapterBackbone=RN50, Pre-trained model=CLIP, shots=42024.05 | 87.46 | 73.38 | 89.98 | 56.86 | 22.59 | 87.17 | 69.05 | 77.92 | 65.96 | 62.45 | 61.84 | 68.61 | |
| Tip-AdapterBackbone=RN50, Pre-trained model=CLIP, shots=22024.05 | 87.03 | 61.68 | 88.44 | 49.47 | 21.21 | 79.13 | 64.74 | 77.52 | 62.7 | 57.93 | 60.96 | 64.62 | |
| Tip-AdapterBackbone=RN50, Pre-trained model=CLIP, shots=82024.05 | 87.03 | 67.95 | 89.83 | 58.63 | 25.59 | 87.98 | 68.68 | 77.76 | 65.62 | 62.93 | 61.45 | 68.5 | |
| Tip-Adapter-FBackbone=RN50, Pre-trained model=CLIP, shots=22024.05 | 87.03 | 66.15 | 89.74 | 53.72 | 23.19 | 82.3 | 66.43 | 77.81 | 63.64 | 61.5 | 61.69 | 66.65 | |
| CoOpBackbone=RN50, Pre-trained model=CLIP, shots=162024.05 | 87.01 | 83.53 | 91.83 | 63.58 | 31.26 | 94.51 | 75.71 | 74.67 | 69.26 | 73.36 | 62.95 | 73.42 | |
| Tip-Adapter-FBackbone=RN50, Pre-trained model=CLIP, shots=12024.05 | 87 | 59.53 | 89.33 | 49.65 | 20.22 | 79.98 | 64.87 | 77.51 | 62.5 | 58.86 | 61.13 | 64.6 | |
| CRoFTBackbone=RN50, Pre-trained model=CLIP, shots=22024.05 | 86.86 | 67.6 | 90.47 | 55.32 | 24.51 | 85.91 | 69.07 | 77.9 | 65.87 | 62.17 | 62.31 | 68 | |
| AdapterBackbone=RN50, Pre-trained model=CLIP, shots=22024.05 | 86.73 | 63.9 | 89.37 | 51.48 | 20.1 | 81.61 | 67.12 | 77.22 | 63.29 | 58.74 | 61.52 | 65.55 | |
| CoOpBackbone=RN50, Pre-trained model=CLIP, shots=42024.05 | 86.7 | 70.18 | 89.55 | 53.49 | 21.87 | 86.2 | 67.03 | 73.33 | 63.47 | 62.62 | 59.99 | 66.77 | |
| Tip-AdapterBackbone=RN50, Pre-trained model=CLIP, shots=42024.05 | 86.45 | 65.32 | 89.39 | 53.96 | 22.41 | 83.8 | 66.46 | 77.54 | 64.15 | 61.45 | 60.98 | 66.54 | |
| CRoFTBackbone=RN50, Pre-trained model=CLIP, shots=12024.05 | 86.43 | 64.64 | 89.49 | 50.18 | 21.81 | 81.45 | 66.3 | 77.36 | 63.03 | 58.86 | 61.61 | 65.56 | |
| Tip-AdapterBackbone=RN50, Pre-trained model=CLIP, shots=12024.05 | 86.1 | 54.38 | 87.18 | 46.22 | 19.05 | 73.12 | 62.6 | 77.42 | 61.3 | 57.54 | 60.7 | 62.33 | |
| AdapterBackbone=RN50, Pre-trained model=CLIP, shots=12024.05 | 85.99 | 61.4 | 88.6 | 45.8 | 17.49 | 73.49 | 62.2 | 76.82 | 61.3 | 55.13 | 61.2 | 62.67 | |
| CoOpBackbone=RN50, Pre-trained model=CLIP, shots=12024.05 | 85.89 | 50.63 | 87.53 | 44.39 | 9.64 | 68.12 | 61.92 | 74.32 | 60.29 | 55.59 | 57.15 | 59.59 | |
| ZS CLIPBackbone=RN50, Pre-trained model=CLIP, shots=02024.05 | 85.77 | 37.56 | 86.29 | 42.32 | 17.28 | 66.14 | 61.46 | 77.31 | 58.52 | 55.74 | 60.32 | 56.69 | |
| CoOpBackbone=RN50, Pre-trained model=CLIP, shots=82024.05 | 85.32 | 76.73 | 90.21 | 59.97 | 26.13 | 91.18 | 71.94 | 71.82 | 65.52 | 68.43 | 61.56 | 69.89 | |
| CoOpBackbone=RN50, Pre-trained model=CLIP, shots=22024.05 | 82.64 | 61.5 | 87.93 | 45.15 | 18.68 | 77.51 | 64.09 | 72.49 | 59.48 | 58.28 | 57.81 | 62.32 |