List your company
ResearchFormerly WizWand

Sentiment Classification on Amz5 (test)

97AccuracyICL-gold
16.9237.7158.579.29Dec 19, 2022
Updated 8mo ago

Evaluation results

MethodLinks
ICL-goldPrompting Method=Direct, Backbone=GPT-3, Oracle=true2022.1297
ICL-randomPrompting Method=Direct, Backbone=GPT-3, Oracle=true2022.1295.4
Z-ICLPrompting Method=Direct, Backbone=GPT-32022.1293
Z-ICLPrompting Method=Channel, Backbone=GPT-32022.1289.1
No-demosPrompting Method=Direct, Backbone=GPT-32022.1288.2
ICL-goldPrompting Method=Channel, Backbone=GPT-3, Oracle=true2022.1286
ICL-randomPrompting Method=Channel, Backbone=GPT-3, Oracle=true2022.1283.4
No-demosPrompting Method=Channel, Backbone=GPT-32022.1277.2
Majority2022.1250
ICL-goldModel=GPT-J, Prompting=Direct, Training data access=true2022.1249
ICL-goldModel=GPT-NeoX, Prompting=Direct, Training data access=true2022.1247
Z-ICLModel=GPT-J, Prompting=Channel, Training data access=false2022.1246.5
ICL-randomModel=GPT-NeoX, Prompting=Direct, Training data access=true2022.1245.6
ICL-goldModel=GPT-J, Prompting=Channel, Training data access=true2022.1245.5
ICL-randomModel=GPT-J, Prompting=Channel, Training data access=true2022.1244.9
Naive Z-ICLModel=GPT-J, Prompting=Channel, Training data access=false2022.1241.7
ICL-goldModel=GPT-NeoX, Prompting=Channel, Training data access=true2022.1241.6
Naive Z-ICLModel=GPT-NeoX, Prompting=Direct, Training data access=false2022.1241.2
Z-ICLModel=GPT-NeoX, Prompting=Direct, Training data access=false2022.1241.2
ICL-randomModel=GPT-J, Prompting=Direct, Training data access=true2022.1241.1
ICL-randomModel=GPT-NeoX, Prompting=Channel, Training data access=true2022.1239.8
Naive Z-ICLModel=GPT-J, Prompting=Direct, Training data access=false2022.1239.6
Random inputsModel=GPT-NeoX, Prompting=Direct, Training data access=false2022.1238.7
Z-ICLModel=GPT-J, Prompting=Direct, Training data access=false2022.1238.5
Random inputsModel=GPT-J, Prompting=Channel, Training data access=false2022.1238.1
Z-ICLModel=GPT-NeoX, Prompting=Channel, Training data access=false2022.1237.8
Random inputsModel=GPT-J, Prompting=Direct, Training data access=false2022.1237.5
Naive Z-ICLModel=GPT-NeoX, Prompting=Channel, Training data access=false2022.1234.7
No-demosModel=GPT-J, Prompting=Channel, Training data access=false2022.1234.4
No-demosModel=GPT-J, Prompting=Direct, Training data access=false2022.1230.4
Random inputsModel=GPT-NeoX, Prompting=Channel, Training data access=false2022.1227.9
No-demosModel=GPT-NeoX, Prompting=Channel, Training data access=false2022.1227.5
No-demosModel=GPT-NeoX, Prompting=Direct, Training data access=false2022.1220.2
MajorityTraining data access=false2022.1220