Stance Detection on Multi-domain Stance Detection Suite (Out-of-domain)

0.5941F1 AverageTESTED (Our Model)

Evaluation results

Method
TESTED (Our Model)2023.06	0.5941	0.508	0.5795	0.7895	0.5562	0.5523	0.808	0.7251	0.617	0.5549	0.3944	0.4054	0.4628	0.4277	0.7207	0.8619	0.5433
TESTED (w/o Contrastive Loss)2023.06	0.5463	0.4796	0.5009	0.7651	0.4749	0.5193	0.7522	0.6869	0.5653	0.4947	0.3395	0.3796	0.441	0.3956	0.6309	0.8359	0.4803
TESTED (Stratified Sampling variant)2023.06	0.5038	0.3847	0.4654	0.6975	0.5534	0.5137	0.6825	0.5941	0.5164	0.4824	0.2804	0.2969	0.3497	0.3813	0.6383	0.832	0.4406
MoLE w/ Weak Mapping2023.06	0.492	0.5181	0.3897	0.5848	0.4723	0.5396	0.8207	0.5157	0.5697	0.4013	0.5129	0.3631	0.3175	0.2275	0.5071	0.7569	0.3715
MoLE w/ Soft Mapping2023.06	0.4656	0.4831	0.3221	0.6273	0.5419	0.5197	0.4686	0.5731	0.5358	0.3788	0.4446	0.3677	0.2892	0.2897	0.5778	0.7211	0.3096
MoLE w/ Hard Mapping2023.06	0.3278	0.2529	0.3515	0.2955	0.228	0.1613	0.5849	0.4705	0.2928	0.2334	0.3293	0.3701	0.2185	0.161	0.3416	0.7293	0.2289