Thematic fit estimation on McRae (test)
0.44Spearman Rho20% subset v2
Evaluation Results
| Method | Links | |
|---|---|---|
| 20% subset v2Backbone=Llama, Category=Baseline2024.10 | 0.44 | |
| ResRoFA-MTBackbone=Llama, Category=Baseline2024.10 | 0.43 | |
| Glove-shared tuned with 20%MBackbone=Llama, Category=Baseline2024.10 | 0.43 | |
| NN RFBackbone=Llama, Category=Baseline2024.10 | 0.38 | |
| GSD2015Backbone=Llama, Category=Baseline2024.10 | 0.36 | |
| Glove-shared tunedBackbone=Llama, Category=Baseline2024.10 | 0.33 | |
| Glove-shared not-tunedBackbone=Llama, Category=Baseline2024.10 | 0.31 | |
| Exp.4.1Backbone=Llama2024.10 | 0.27 | |
| Exp.2.1Backbone=Llama2024.10 | 0.25 | |
| Exp.2.2Backbone=Llama2024.10 | 0.23 | |
| Exp.3.1Backbone=Llama2024.10 | 0.23 | |
| Exp.4.2Backbone=Llama2024.10 | 0.21 | |
| Exp.3.2Backbone=Llama2024.10 | 0.2 | |
| Exp.1.1Backbone=Llama2024.10 | 0.16 | |
| Exp.1.2Backbone=Llama2024.10 | 0.13 |