Sociopragmatic classification on 8 out-of-domain sociopragmatic datasets (test)
42.19Avg F1 (N=20)DCL
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| DCLtraining_method=DCL2022.03 | 42.19 | 56.62 | 68.22 | 71.21 | |
| InfoDCL-ROBERTabase_model=RoBERTa, training_method=InfoDCL2022.03 | 40.96 | 58.51 | 69.36 | 71.92 | |
| SimCSE-Distanttraining_method=SimCSE-Distant2022.03 | 39.02 | 53.95 | 66.85 | 70.5 | |
| InfoDCL-BERTweetbase_model=BERTweet, training_method=InfoDCL2022.03 | 38.72 | 48.87 | 65.64 | 69.25 | |
| BERTweetbase_model=BERTweet2022.03 | 30.89 | 39.4 | 62.52 | 68.22 | |
| RoBERTabase_model=RoBERTa-base2022.03 | 27.07 | 41.12 | 69.26 | 71.42 |