Sound Symbolism Probing on Sound Symbolism Probing Phonetic-level ϕ(ω)
98AUCDeepFloyd-IF
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DeepFloyd-IFPrecision=half-precision, Inference Stage=first stage, Resolution=64x642023.10 | 98 | 0.7 | |
| GALIPSettings=default2023.10 | 98 | 0.7 | |
| CLIPSettings=default2023.10 | 98 | 0.7 | |
| CLIPtraining=vision-and-language2023.10 | 98 | 0.7 | |
| Stable DiffusionSettings=default2023.10 | 97 | 0.68 | |
| Stable Diffusiontraining=vision-and-language2023.10 | 97 | 0.68 | |
| KandinskyPrecision=half-precision, Pipeline=prior and image-to-text, Guidance Scale=1, Resolution=768x7682023.10 | 85 | 0.51 | |
| SMPNettraining=unimodal (text-only), fine-tuned objective=Sentence Transformer2023.10 | 82 | 0.46 | |
| SRoBERTatraining=unimodal (text-only), fine-tuned objective=Sentence Transformer2023.10 | 71 | 0.3 | |
| SMiniLMtraining=unimodal (text-only), fine-tuned objective=Sentence Transformer2023.10 | 57 | 0.1 | |
| SALBERTtraining=unimodal (text-only), fine-tuned objective=Sentence Transformer2023.10 | 54 | 0.06 | |
| (random)2023.10 | 50 | 0 | |
| random baseline2023.10 | 50 | 0 |