Thematic fit estimation on Pado (test)
0.59Spearman RhoGlove-shared tuned with 20%M
Evaluation Results
| Method | Links | |
|---|---|---|
| Glove-shared tuned with 20%MBackbone=Llama, Category=Baseline2024.10 | 0.59 | |
| GSD2015Backbone=Llama, Category=Baseline2024.10 | 0.53 | |
| ResRoFA-MTBackbone=Llama, Category=Baseline2024.10 | 0.53 | |
| Glove-shared tunedBackbone=Llama, Category=Baseline2024.10 | 0.53 | |
| NN RFBackbone=Llama, Category=Baseline2024.10 | 0.52 | |
| Glove-shared not-tunedBackbone=Llama, Category=Baseline2024.10 | 0.49 | |
| 20% subset v2Backbone=Llama, Category=Baseline2024.10 | 0.43 | |
| Exp.2.1Backbone=Llama2024.10 | 0.31 | |
| Exp.1.1Backbone=Llama2024.10 | 0.27 | |
| Exp.1.2Backbone=Llama2024.10 | 0.26 | |
| Exp.2.2Backbone=Llama2024.10 | 0.22 | |
| Exp.4.2Backbone=Llama2024.10 | 0.12 | |
| Exp.3.2Backbone=Llama2024.10 | 0.1 | |
| Exp.4.1Backbone=Llama2024.10 | 0.06 | |
| Exp.3.1Backbone=Llama2024.10 | 0.05 |