Sentiment Analysis on SST-2 (test) (Statistical Accuracy Summary)
86.7Avg AccuracyCONDACC
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CONDACCBackbone=GPTJ-6B2022.12 | 86.7 | 5.9 | 68.2 | |
| DATAMODELSBackbone=GPTJ-6B2022.12 | 86 | 7.5 | 60.8 | |
| UN-CONDACCBackbone=GPTJ-6B2022.12 | 85.3 | 6.8 | 60.5 | |
| ALL + CALIBBackbone=OPT-13B2022.12 | 84.7 | 6.8 | 51.7 | |
| CONDACCBackbone=OPT-13B2022.12 | 83.6 | 9.1 | 56.1 | |
| TOPPROMPTS-5Backbone=GPTJ-6B2022.12 | 82.8 | 8.6 | 56 | |
| UN-ONESHOTBackbone=GPTJ-6B2022.12 | 81.9 | 6.3 | 68.5 | |
| DATAMODELSBackbone=OPT-13B2022.12 | 81.3 | 10.3 | 60.3 | |
| UN-CONDACCBackbone=OPT-13B2022.12 | 80.3 | 12.8 | 50 | |
| UN-TOPPROMPTS-5Backbone=GPTJ-6B2022.12 | 80.1 | 10.5 | 56.8 | |
| ONESHOTBackbone=GPTJ-6B2022.12 | 79.6 | 10.5 | 52.1 | |
| TOPPROMPTS-10Backbone=GPTJ-6B2022.12 | 78.5 | 9.3 | 52.4 | |
| ALLBackbone=GPTJ-6B2022.12 | 77.8 | 11.2 | 50.8 | |
| ONESHOTBackbone=OPT-13B2022.12 | 75.6 | 13.1 | 50.7 | |
| ALL + CALIBBackbone=GPTJ-6B2022.12 | 75.5 | 9.5 | 53.6 | |
| UN-ONESHOTBackbone=OPT-13B2022.12 | 74.8 | 15.6 | 50 | |
| RANDOMBackbone=GPTJ-6B2022.12 | 74.6 | 11.4 | 50.3 | |
| TOPPROMPTS-10Backbone=OPT-13B2022.12 | 72.9 | 15.6 | 50 | |
| UN-ALLBackbone=GPTJ-6B2022.12 | 71 | 11.9 | 50 | |
| UN-TOPPROMPTS-5Backbone=OPT-13B2022.12 | 70.5 | 17 | 50 | |
| TOPPROMPTS-5Backbone=OPT-13B2022.12 | 69.6 | 14.7 | 50 | |
| ALLBackbone=OPT-13B2022.12 | 68.5 | 14 | 50 | |
| RANDOMBackbone=OPT-13B2022.12 | 67.7 | 14.1 | 50 | |
| UN-ALLBackbone=OPT-13B2022.12 | 61.6 | 13.6 | 50 |