List your company
ResearchFormerly WizWand

Thematic fit estimation on Fer-Loc

0.69Spearman Correlation (ρ)Step-by-Step Prompting
0.20120.32810.4550.5819Oct 19, 2024
Updated 8mo ago

Evaluation results

MethodLinks
Step-by-Step PromptingBackbone=GPT4-Turbo, Experiment ID=Exp.3.1, Input Form=Lemma Tuples, Output Form=Numeric2024.100.69
Step-by-Step PromptingBackbone=GPT4-Turbo, Experiment ID=Exp.3.2, Input Form=Lemma Tuples, Output Form=Categorical2024.100.68
Simple PromptingBackbone=GPT4-Turbo, Experiment ID=Exp.1.1, Input Form=Lemma Tuples, Output Form=Numeric2024.100.63
Simple PromptingBackbone=GPT4-Turbo, Experiment ID=Exp.1.2, Input Form=Lemma Tuples, Output Form=Categorical2024.100.61
GPT4.1 (Exp.3.1)Reasoning=Step-by-Step Prompting, Input=Lemma Tuples, Output=Numeric2024.100.59
Step-by-Step PromptingBackbone=GPT4-Turbo, Experiment ID=Exp.4.2, Input Form=Generated Sentences, Output Form=Categorical2024.100.58
Step-by-Step PromptingBackbone=GPT4-Turbo, Experiment ID=Exp.4.1, Input Form=Generated Sentences, Output Form=Numeric2024.100.57
GPT4.1 (Exp.3.2)Reasoning=Step-by-Step Prompting, Input=Lemma Tuples, Output=Categorical2024.100.56
GPT4.1 (Exp.4.1)Reasoning=Step-by-Step Prompting, Input=Generated Sentences, Output=Numeric2024.100.56
GPT4.1 (Exp.4.2)Reasoning=Step-by-Step Prompting, Input=Generated Sentences, Output=Categorical2024.100.53
GPT4.1 (Exp.1.1)Reasoning=Standard Prompting, Input=Lemma Tuples, Output=Numeric2024.100.51
GPT4.1 (Exp.1.2)Reasoning=Standard Prompting, Input=Lemma Tuples, Output=Categorical2024.100.5
Simple PromptingBackbone=GPT4-Turbo, Experiment ID=Exp.2.1, Input Form=Generated Sentences, Output Form=Numeric2024.100.48
ResRoFA-MT2024.100.46
ResRoFA-MTMethod ID=B12024.100.46
ResRoFA-MTLabel=B12024.100.46
Simple PromptingBackbone=GPT4-Turbo, Experiment ID=Exp.2.2, Input Form=Generated Sentences, Output Form=Categorical2024.100.46
NN RF2024.100.44
NN RFMethod ID=B02024.100.44
NN RFLabel=B02024.100.44
Exp.3.1Backbone=Qwen2024.100.41
Exp.3.2Backbone=Qwen2024.100.41
Exp.1.2Backbone=Qwen2024.100.38
Exp.2.2Backbone=Qwen2024.100.37
Glove-sharedtuning=tuned, data=20% subset2024.100.35
Glove-shared tuned with 20%MMethod ID=B3c2024.100.35
Glove-sharedLabel=B3c, Tuning Status=tuned, Training Subset=20%M2024.100.35
GPT4.1 (Exp.2.1)Reasoning=Standard Prompting, Input=Generated Sentences, Output=Numeric2024.100.32
Exp.2.1Backbone=Qwen2024.100.31
Exp.4.1Backbone=Qwen2024.100.31
Glove-sharedtuning=not-tuned2024.100.3
Glove-shared not-tunedMethod ID=B3a2024.100.3
Glove-sharedLabel=B3a, Tuning Status=not-tuned2024.100.3
GSD20152024.100.29
Glove-sharedtuning=tuned2024.100.29
GSD2015Method ID=BG2024.100.29
Glove-shared tunedMethod ID=B3b2024.100.29
Exp.1.1Backbone=Qwen2024.100.29
GSD2015Label=BG2024.100.29
Glove-sharedLabel=B3b, Tuning Status=tuned2024.100.29
GPT4.1 (Exp.2.2)Reasoning=Standard Prompting, Input=Generated Sentences, Output=Categorical2024.100.26
Exp.4.2Backbone=Qwen2024.100.22