Multi-label Emotion Classification on SemEval Task 1:E-c 2018 (test)
57.8Macro F1SpanEmo
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| SpanEmo2021.01 | 57.8 | 0.601 | 71.3 | |
| JSCLlanguage=English, backbone=bert-base, loss_type=Jaccard Similarity Contrastive Loss2022.12 | 57.68 | 59.05 | 71.01 | |
| SCLlanguage=English, backbone=bert-base, loss_type=Strict Contrastive Loss2022.12 | 57.63 | 58.89 | 70.8 | |
| ICLlanguage=English, backbone=bert-base, loss_type=Intra-label Contrastive Loss2022.12 | 57.59 | 58.6 | 70.49 | |
| JSPCLlanguage=English, backbone=bert-base, loss_type=Jaccard Similarity Probability Contrastive Loss2022.12 | 57.42 | 58.58 | 70.75 | |
| SpanEmolanguage=English, backbone=bert-base2022.12 | 57 | 58.3 | 70.32 | |
| BERT-GATEncoder=BERT, Graph Network=GAT2020.08 | 56.9 | 58.3 | 69.9 | |
| LEM2021.01 | 56.7 | — | 67.5 | |
| LEMlanguage=English2022.12 | 56.7 | — | 67.5 | |
| SLCLlanguage=English, backbone=bert-base, loss_type=Stepwise Label Contrastive Loss2022.12 | 56.62 | 58.9 | 70.9 | |
| BERT-GCNEncoder=BERT, Graph Network=GCN2020.08 | 56.3 | 58.9 | 70.7 | |
| BERT_base - GCNgraph_integration=GCN2021.01 | 56.3 | 0.589 | 70.7 | |
| Transformerfinetuned=true2018.12 | 56.1 | 57.7 | 69 | |
| DATN2021.01 | 55.1 | 0.583 | — | |
| DATNlanguage=English2022.12 | 55.1 | 58.3 | — | |
| BERT_base + DKdomain_knowledge=true2021.01 | 54.9 | 0.591 | 71.3 | |
| SLCL2026.02 | 54.8 | 54.6 | 66.3 | |
| DATN2020.08 | 54.4 | 58.3 | — | |
| Baziotis et al.2018.12 | 54.2 | 59.5 | 70.9 | |
| ICL2026.02 | 54.2 | 54.2 | 66.1 | |
| SCL2026.02 | 54.2 | 55.4 | 66.7 | |
| JSCL2026.02 | 54 | 54.1 | 66 | |
| RERC2021.01 | 53.9 | — | 65.1 | |
| ReRclanguage=English2022.12 | 53.9 | — | 65.1 | |
| BERTEncoder=BERT2020.08 | 53.8 | 58.4 | 70.1 | |
| JSPCL2026.02 | 53.7 | 53.9 | 65.8 | |
| Meisheri and Dey2018.12 | 53.4 | 58.2 | 69.4 | |
| SpanEmo2021.01 | 53.2 | 53.2 | 64.1 | |
| NTUA-SLP2020.08 | 52.8 | 58.8 | 70.1 | |
| JBNN2021.01 | 52.8 | — | 63.2 | |
| NTUA2021.01 | 52.8 | 0.588 | 70.1 | |
| BNNlanguage=English2022.12 | 52.8 | — | 63.2 | |
| NTUAlanguage=English2022.12 | 52.8 | 58.8 | 70.1 | |
| Ours (Ambiguity)2026.02 | 52.7 | 52.4 | 79.7 | |
| SpanEmo2021.01 | 52.1 | 54.8 | 66.6 | |
| SpanEmo2026.02 | 52.1 | 54.8 | 66.6 | |
| BERT_basemodel_variant=base2021.01 | 52 | 0.57 | 69.5 | |
| HEF2021.01 | 50.2 | 51.2 | 63.1 | |
| HEF2026.02 | 50.2 | 51.2 | 63.1 | |
| TRS-GCNEncoder=Transformer, Graph Network=GCN2020.08 | 49.2 | 51.9 | 63.8 | |
| TRS-GATEncoder=Transformer, Graph Network=GAT2020.08 | 48.3 | 51.7 | 64.6 | |
| BERT_basemodel_variant=base2021.01 | 47.7 | 52.3 | 65 | |
| BERTbase2026.02 | 47.7 | 52.3 | 65 | |
| BERT_basemodel_variant=base2021.01 | 47.4 | 48.7 | 59.6 | |
| TRSEncoder=Transformer2020.08 | 46.7 | 51.1 | 63.4 | |
| EMA2021.01 | 46.1 | 48.9 | 61.8 | |
| EMA2026.02 | 46.1 | 48.9 | 61.8 | |
| Tw-StAR2021.01 | 44.6 | 46.5 | 59.7 | |
| Tw-StAR2026.02 | 44.6 | 46.5 | 59.7 | |
| ELIRF2021.01 | 44 | 45.8 | 53.5 | |
| SGM2020.08 | 41.1 | 48.2 | 57.5 | |
| MILAB2021.01 | 40.7 | 46.9 | 55.8 | |
| Tw-StAR2021.01 | 39.2 | 43.8 | 52 |