Human judgment correlation on C-CUB Color 1.0 (test)
0.5949PCCHuman
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Human2022.05 | 0.5949 | 0.589 | 81.7 | — | — | |
| CLIP-Sfine-tuned=true2022.05 | 0.3711 | 0.3428 | 77.5 | 27.24 | 25.05 | |
| MIDfine-tuned=true2022.05 | 0.3558 | 0.399 | 76.5 | 31.8 | 29.24 | |
| MIDfine-tuned=false2022.05 | 0.2863 | 0.3499 | 68.5 | 27.68 | 25.45 | |
| CLIP-R-Precisionfine-tuned=true, reproduction=true2022.05 | 0.2538 | 0.2474 | 62.1 | 28.04 | 21.9 | |
| CLIP-Sfine-tuned=false2022.05 | 0.1919 | 0.1865 | 67 | 14.78 | 13.59 | |
| CLIP-R-Precisionfine-tuned=false, reproduction=true2022.05 | 0.141 | 0.1426 | 53.3 | 13.02 | 12.62 | |
| CLIP-R-Precisionfine-tuned=true, reproduction=false2022.05 | 0.0752 | 0.1263 | 56.4 | — | — | |
| DAMSM2022.05 | 0.0503 | 0.1224 | 54.9 | — | — |