Sentiment Classification on Tweet (test)
48AccuracyICL-gold
Evaluation Results
| Method | Links | |
|---|---|---|
| ICL-goldModel=GPT-J, Prompting=Channel, Training data access=true2022.12 | 48 | |
| ICL-goldModel=GPT-NeoX, Prompting=Channel, Training data access=true2022.12 | 47.9 | |
| No-demosModel=GPT-J, Prompting=Channel, Training data access=false2022.12 | 47.6 | |
| Z-ICLModel=GPT-J, Prompting=Channel, Training data access=false2022.12 | 46.8 | |
| ICL-randomModel=GPT-J, Prompting=Channel, Training data access=true2022.12 | 46.8 | |
| Z-ICLModel=GPT-NeoX, Prompting=Channel, Training data access=false2022.12 | 46.7 | |
| ICL-randomModel=GPT-NeoX, Prompting=Channel, Training data access=true2022.12 | 44 | |
| ICL-goldPrompting Method=Channel, Backbone=GPT-3, Oracle=true2022.12 | 43.8 | |
| ICL-randomPrompting Method=Direct, Backbone=GPT-3, Oracle=true2022.12 | 42.2 | |
| Naive Z-ICLModel=GPT-J, Prompting=Channel, Training data access=false2022.12 | 42.2 | |
| Random inputsModel=GPT-J, Prompting=Channel, Training data access=false2022.12 | 41.5 | |
| Z-ICLPrompting Method=Channel, Backbone=GPT-32022.12 | 41.4 | |
| ICL-randomPrompting Method=Channel, Backbone=GPT-3, Oracle=true2022.12 | 41.4 | |
| Naive Z-ICLModel=GPT-NeoX, Prompting=Direct, Training data access=false2022.12 | 40.2 | |
| No-demosModel=GPT-J, Prompting=Direct, Training data access=false2022.12 | 39.5 | |
| Naive Z-ICLModel=GPT-NeoX, Prompting=Channel, Training data access=false2022.12 | 38.9 | |
| Majority2022.12 | 38.1 | |
| MajorityTraining data access=false2022.12 | 38.1 | |
| No-demosPrompting Method=Direct, Backbone=GPT-32022.12 | 37.8 | |
| Random inputsModel=GPT-NeoX, Prompting=Direct, Training data access=false2022.12 | 36.4 | |
| No-demosPrompting Method=Channel, Backbone=GPT-32022.12 | 36.2 | |
| Z-ICLModel=GPT-NeoX, Prompting=Direct, Training data access=false2022.12 | 35.2 | |
| ICL-goldModel=GPT-J, Prompting=Direct, Training data access=true2022.12 | 35 | |
| Random inputsModel=GPT-NeoX, Prompting=Channel, Training data access=false2022.12 | 34.6 | |
| ICL-randomModel=GPT-J, Prompting=Direct, Training data access=true2022.12 | 33.4 | |
| ICL-randomModel=GPT-NeoX, Prompting=Direct, Training data access=true2022.12 | 33.1 | |
| ICL-goldModel=GPT-NeoX, Prompting=Direct, Training data access=true2022.12 | 32.8 | |
| Naive Z-ICLModel=GPT-J, Prompting=Direct, Training data access=false2022.12 | 32.3 | |
| No-demosModel=GPT-NeoX, Prompting=Direct, Training data access=false2022.12 | 30.8 | |
| ICL-goldPrompting Method=Direct, Backbone=GPT-3, Oracle=true2022.12 | 30.5 | |
| Random inputsModel=GPT-J, Prompting=Direct, Training data access=false2022.12 | 28.8 | |
| No-demosModel=GPT-NeoX, Prompting=Channel, Training data access=false2022.12 | 28.7 | |
| Z-ICLPrompting Method=Direct, Backbone=GPT-32022.12 | 28.3 | |
| Z-ICLModel=GPT-J, Prompting=Direct, Training data access=false2022.12 | 20.5 |