Detection on TweetEval stance-feminist (test)
41.3Macro F1GPT-J (DC)
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-J (DC)Backbone=GPT-J, Prompting=DC, Shots=8-shot2023.05 | 41.3 | |
| GPT-J (Original)Backbone=GPT-J, Prompting=Original, Shots=8-shot2023.05 | 40.4 | |
| GPT-J (CC)Backbone=GPT-J, Prompting=CC, Shots=8-shot2023.05 | 34.6 | |
| RoBERTa-large (Domain-context Calibration)Model=RoBERTa-large, Setting=DC, Evaluation protocol=Zero-shot prompting2023.05 | 29.4 | |
| RoBERTa-large (Context Calibration)Model=RoBERTa-large, Setting=CC, Evaluation protocol=Zero-shot prompting2023.05 | 28 | |
| RoBERTa-large (Original)Model=RoBERTa-large, Setting=Original, Evaluation protocol=Zero-shot prompting2023.05 | 22.4 |