List your company

Specificity Testing on S 1.0 (test)

89Birthplace AccuracyRoBERTa-Large (CP)
40.286452.933265.5878.2268Oct 11, 2022

Evaluation results

MethodLinks
RoBERTa-Large (CP)Backbone=RoBERTa-Large, Prompting Technique=Cascade Prompting2022.108974.0266.0979.8765.1874.83
BERT-Large (CP)Backbone=BERT-Large, Prompting Technique=Cascade Prompting2022.1082.2570.0253.5577.6771.8871.07
GPT-2 (FP)Backbone=GPT-2, Prompting Technique=Few-shot Prompting, Number of demonstrations (K)=102022.1081.0171.6650.3364.1557.6764.96
RoBERTa-Large (FP)Backbone=RoBERTa-Large, Prompting Technique=Few-shot Prompting, Number of demonstrations (K)=102022.1070.5171.9442.2673.762.9464.27
BERT-Base (FP)Backbone=BERT-Base, Prompting Technique=Few-shot Prompting, Number of demonstrations (K)=102022.1067.8570.5450.1169.1153.8362.29
BERT-Large (FP)Backbone=BERT-Large, Prompting Technique=Few-shot Prompting, Number of demonstrations (K)=102022.1066.1764.750.3765.4452.2459.78
RoBERTa-Base (FP)Backbone=RoBERTa-Base, Prompting Technique=Few-shot Prompting, Number of demonstrations (K)=102022.1064.8572.3835.8563.0151.1157.44
RoBERTa-Base (CP)Backbone=RoBERTa-Base, Prompting Technique=Cascade Prompting2022.1063.0964.5454.5661.8162.7861.36
BERT-Base (VP)Backbone=BERT-Base, Prompting Technique=Vanilla Prompting2022.1060.6870.4649.0967.6467.4163.06
GPT-2 (VP)Backbone=GPT-2, Prompting Technique=Vanilla Prompting2022.1059.7257.2848.2557.9860.8656.82
GPT-2 (CP)*Backbone=GPT-2, Prompting Technique=Cascade Prompting, Rescore all suffixes=false2022.1059.7257.2848.2557.9860.8656.82
BERT-Base (CP)Backbone=BERT-Base, Prompting Technique=Cascade Prompting2022.1059.6870.5455.0667.4269.4964.44
BERT-Large (VP)Backbone=BERT-Large, Prompting Technique=Vanilla Prompting2022.1056.5271.7642.3677.2566.7762.93
RoBERTa-Base (VP)Backbone=RoBERTa-Base, Prompting Technique=Vanilla Prompting2022.1054.4861.849.9961.5959.1157.39
RoBERTa-Large (VP)Backbone=RoBERTa-Large, Prompting Technique=Vanilla Prompting2022.1042.1671.4443.2880.6359.2759.36