Concreteness Prediction Dataset
0.634Pearson Correlation (rho)OpenCLIP
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| OpenCLIPProbing Method=SP2023.03 | 0.634 | 0.643 | 0.432 | |
| FLAVAProbing Method=SP2023.03 | 0.608 | 0.665 | 0.449 | |
| CLIPProbing Method=SP2023.03 | 0.603 | 0.624 | 0.437 | |
| CLIPinput=text-only, probing=linear2023.03 | 0.513 | 0.495 | 0.339 | |
| ERNIEProbing Method=SP2023.03 | 0.461 | 0.496 | 0.338 | |
| RoBERTa-baseProbing Method=MLM2023.03 | 0.433 | 0.404 | 0.275 | |
| LXMERTinput=text-only, probing=linear2023.03 | 0.421 | 0.37 | 0.249 | |
| BERT-baseProbing Method=MLM2023.03 | 0.414 | 0.416 | 0.283 | |
| VisualBERTinput=text-only, probing=linear2023.03 | 0.4 | 0.412 | 0.281 | |
| ERNIE-largeProbing Method=SP2023.03 | 0.358 | 0.353 | 0.233 | |
| BERT-largeProbing Method=MLM2023.03 | 0.348 | 0.355 | 0.239 | |
| RoBERTa-largeProbing Method=MLM2023.03 | 0.345 | 0.374 | 0.253 | |
| SBERTProbing Method=SP2023.03 | 0.338 | 0.337 | 0.228 | |
| BERTprobing=linear2023.03 | 0.233 | 0.238 | 0.159 |