Human judgment correlation on comp-t2i C-CUB Shape 1.0 (test)
0.3949PCCHuman
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Human2022.05 | 0.3949 | 0.4007 | 0.7 | — | — | |
| DAMSM2022.05 | 0.1229 | 0.017 | 0.527 | — | — | |
| MIDfine-tuned=true2022.05 | 0.1118 | 0.128 | 0.6 | 9.96 | 9.14 | |
| MIDfine-tuned=false2022.05 | 0.1113 | 0.1079 | 0.55 | 8.56 | 7.85 | |
| CLIP-R-Precisionfine-tuned=true, reproduction=true2022.05 | 0.1096 | 0.1063 | 0.463 | 11.97 | 9.4 | |
| CLIP-R-Precisionfine-tuned=true, reproduction=false2022.05 | 0.0878 | 0.0806 | 0.522 | — | — | |
| CLIP-Sfine-tuned=true2022.05 | 0.0577 | 0.0593 | 0.565 | 4.64 | 4.26 | |
| CLIP-Sfine-tuned=false2022.05 | 0.0287 | 0.0315 | 0.61 | 2.37 | 2.17 | |
| CLIP-R-Precisionfine-tuned=false, reproduction=true2022.05 | 0.0071 | 0.0078 | 0.439 | 0.7 | 0.69 |