Stance Detection on Multi-domain Stance Detection Dataset In-domain 1.0 (test)
69.12F1 (Average)TESTED (Our Model)
Evaluation results
| Method | Links | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| TESTED (Our Model)2023.06 | 69.12 | 64.82 | 56.97 | 83.11 | 52.76 | 64.71 | 82.1 | 83.17 | 78.61 | 63.96 | 66.58 | 60.91 | 58.72 | 70.98 | 62.79 | 88.06 | 57.47 | |
| TESTEDContrastive Objective=None2023.06 | 65.63 | 61.11 | 55.5 | 81.85 | 43.81 | 63.04 | 80.84 | 79.05 | 73.43 | 62.18 | 61.57 | 60.17 | 56.06 | 68.79 | 59.51 | 86.94 | 56.35 | |
| MOLE2023.06 | 65.55 | 63.17 | 38.5 | 85.27 | 50.76 | 65.91 | 83.74 | 75.82 | 75.07 | 65.08 | 67.24 | 70.05 | 57.78 | 68.37 | 63.73 | 79.38 | 38.92 | |
| TESTEDSampling Strategy=Topic -> Stratified Sampling2023.06 | 64.01 | 50.27 | 51.57 | 77.78 | 46.67 | 62.13 | 79 | 77.9 | 76.44 | 61.5 | 64.92 | 66.88 | 51.96 | 69.47 | 56.76 | 78.3 | 51.16 | |
| TESTEDSampling Strategy=Topic Sampling -> Stratified, Contrastive Loss=None2023.06 | 63.24 | 60.98 | 49.17 | 77.85 | 45.54 | 58.23 | 77.36 | 75.8 | 74.77 | 60.85 | 63.69 | 62.59 | 54.74 | 62.85 | 53.67 | 86.04 | 47.72 | |
| TESTEDSampling Strategy=Topic -> Random Sampling2023.06 | 61.14 | 53.92 | 42.59 | 77.68 | 44.08 | 52.54 | 67.55 | 75.6 | 72.67 | 56.35 | 59.08 | 60.88 | 57.28 | 69.32 | 52.02 | 76.93 | 53.8 | |
| Random baseline2023.06 | 35.19 | 18.5 | 30.66 | 50.06 | 48.67 | 50.08 | 31.83 | 18.64 | 45.49 | 33.15 | 20.43 | 31.11 | 17.02 | 20.01 | 49.94 | 50.08 | 33.25 | |
| Majority class baseline2023.06 | 27.6 | 21.45 | 21.27 | 34.66 | 39.38 | 35.3 | 21.3 | 20.96 | 43.98 | 19.49 | 25.15 | 24.27 | 22.34 | 15.91 | 33.83 | 34.06 | 17.19 |