Emotion Detection on EmoryNLP (test)
0.4611Weighted-F1TODKAT+HCL
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| TODKAT+HCLHCL=true2021.12 | 0.4611 | — | — | — | — | — | — | |
| TODKATHCL=false2021.12 | 0.4312 | — | — | — | — | — | — | |
| LaERC-SBackbone=Llama2-7B, Mechanism=oReact2024.03 | 0.4208 | — | — | — | — | — | — | |
| BiosERCbackbone=Llama-2-13b, training=fine-tuned, #T.Params.=125 x 10^62024.07 | 0.4168 | — | — | — | — | — | — | |
| BiosERCbackbone=Llama-2-7b, training=fine-tuned, #T.Params.=80 x 10^62024.07 | 0.4144 | — | — | — | — | — | — | |
| BiosERCType=LLMs-based ERC, Backbone=Llama2-7B2024.03 | 0.4144 | — | — | — | — | — | — | |
| InstructERCtraining=fine-tuned LLM2024.07 | 0.4139 | — | — | — | — | — | — | |
| InstructERCBackbone=LLaMA2-7B, Evaluation Setting=LoRA Fine-tuned2023.09 | 0.4137 | — | — | — | — | — | — | |
| InstructERCType=LLMs-based ERC, Backbone=Llama2-7B2024.03 | 0.4137 | — | — | — | — | — | — | |
| MFAMType=Conventional ERC2024.03 | 0.4106 | — | — | — | — | — | — | |
| SPCL-CL-ERCstrategy=Supervised Prototypical Contrastive Learning + Curriculum Learning2022.10 | 0.4094 | — | — | — | — | — | — | |
| LaERCBackbone=Llama2-7B, Protocol=Finetuning2024.03 | 0.4087 | — | — | — | — | — | — | |
| DualGATsModel Category=Discriminant Model2023.09 | 0.4029 | — | — | — | — | — | — | |
| DualGATsType=Conventional ERC2024.03 | 0.4029 | — | — | — | — | — | — | |
| SPCL+CLModel Category=Discriminant Model2023.09 | 0.4025 | — | — | — | — | — | — | |
| SPCLType=Conventional ERC2024.03 | 0.4025 | — | — | — | — | — | — | |
| SGED + DAG-ERC2022.10 | 0.4024 | — | — | — | — | — | — | |
| SGED + DAG-ERC2024.07 | 0.4024 | — | — | — | — | — | — | |
| SkierModel Category=Discriminant Model2023.09 | 0.4007 | — | — | — | — | — | — | |
| S+PAGE2024.07 | 0.4005 | — | — | — | — | — | — | |
| MPLPModel Category=Discriminant Model2023.09 | 0.4001 | — | — | — | — | — | — | |
| BiosERCbackbone=BERT-based, #T.Params.=186 x 10^62024.07 | 0.3989 | — | — | — | — | — | — | |
| DAG-ERC+HCLHCL=true2021.12 | 0.3982 | — | — | — | — | — | — | |
| MKFMType=Conventional ERC2024.03 | 0.3976 | — | — | — | — | — | — | |
| SACL-LSTM# Param.=2.6M, features=roberta-large2023.06 | 0.3965 | — | — | — | — | — | 42.21 | |
| EmotionICModel Category=Discriminant Model2023.09 | 0.3965 | — | — | — | — | — | — | |
| SPCL+CL# Param.=356.7M, features=roberta-large2023.06 | 0.3945 | — | — | — | — | — | 40.32 | |
| SACLModel Category=Discriminant Model2023.09 | 0.3944 | — | — | — | — | — | — | |
| InstructERCBackbone=LLaMA-7B, Evaluation Setting=LoRA Fine-tuned2023.09 | 0.3934 | — | — | — | — | — | — | |
| INTRA/INTER ERC (baseline)#T.Params.=189 x 10^62024.07 | 0.3933 | — | — | — | — | — | — | |
| TUCORE-GCN_RoBERTaBackbone=RoBERTa2022.10 | 0.3924 | — | — | — | — | — | — | |
| S+PAGE2021.12 | 0.3914 | — | — | — | — | — | — | |
| InstructERCBackbone=ChatGLM2-6B, Evaluation Setting=LoRA Fine-tuned2023.09 | 0.3909 | — | — | — | — | — | — | |
| CoG-BARTbackbone=BART2021.12 | 0.3904 | — | — | — | — | — | — | |
| Cog-BARTBackbone=BART2022.10 | 0.3904 | — | — | — | — | — | — | |
| DAG-ERC2021.12 | 0.3902 | — | — | — | — | — | — | |
| DAG-ERC2021.12 | 0.3902 | — | — | — | — | — | — | |
| DAG-ERCHCL=false2021.12 | 0.3902 | — | — | — | — | — | — | |
| DAG-ERC2022.10 | 0.3902 | — | — | — | — | — | — | |
| DAG2024.07 | 0.3902 | — | — | — | — | — | — | |
| COSMIC+HCLHCL=true2021.12 | 0.3896 | — | — | — | — | — | — | |
| CoMPM2022.10 | 0.3893 | — | — | — | — | — | — | |
| DialogueEIN2024.07 | 0.3892 | — | — | — | — | — | — | |
| DialogueCRN2022.10 | 0.3891 | — | — | — | — | — | — | |
| SKAIGType=Conventional ERC2024.03 | 0.3888 | — | — | — | — | — | — | |
| DialogueCRN# Param.=3.3M, features=roberta-large2023.06 | 0.3879 | — | — | — | — | — | 41.04 | |
| TODKAT2022.10 | 0.3869 | — | — | — | — | — | — | |
| TODKATexternal_knowledge=true, features=roberta-large2023.06 | 0.3869 | — | — | — | — | — | 42.38 | |
| COSMIC# Param.=11.9M, external_knowledge=true, features=roberta-large2023.06 | 0.3849 | — | — | — | — | — | 41.79 | |
| COSMICType=Conventional ERC2024.03 | 0.3849 | — | — | — | — | — | — | |
| DAG-ERC# Param.=9.5M, features=roberta-large2023.06 | 0.3829 | — | — | — | — | — | 39.64 | |
| LoRABackbone=LLaMA2-7B, Evaluation Setting=Fine-tuned2023.09 | 0.3821 | — | — | — | — | — | — | |
| HiDialogbase_model=RoBERTa_s2023.04 | 0.3813 | — | — | — | — | — | — | |
| COSMICHCL=false2021.12 | 0.3811 | — | — | — | — | — | — | |
| COSMIC2022.10 | 0.3811 | — | — | — | — | — | — | |
| SGED+DAG# Param.=3.0M, features=roberta-large2023.06 | 0.3811 | — | — | — | — | — | 39.19 | |
| RoBERTa_s2023.04 | 0.3803 | — | — | — | — | — | — | |
| LoRABackbone=LLaMA-7B, Evaluation Setting=Fine-tuned2023.09 | 0.3798 | — | — | — | — | — | — | |
| RGAT+ROBERTabackbone=ROBERTa2021.12 | 0.3789 | — | — | — | — | — | — | |
| CauAIN# Param.=6.1M, external_knowledge=true, features=roberta-large2023.06 | 0.3787 | — | — | — | — | — | 43.13 | |
| CauAINType=Conventional ERC2024.03 | 0.3787 | — | — | — | — | — | — | |
| LoRABackbone=ChatGLM2-6B, Evaluation Setting=Fine-tuned2023.09 | 0.3769 | — | — | — | — | — | — | |
| ChatGPTType=LLMs-based ERC2024.03 | 0.3755 | — | — | — | — | — | — | |
| DialogueRNN# Param.=9.9M, features=roberta-large2023.06 | 0.3754 | — | — | — | — | — | 43.66 | |
| COG-BART# Param.=415.1M, features=bart-large2023.06 | 0.3733 | — | — | — | — | — | 40.94 | |
| COSMIC2021.12 | 0.371 | — | — | — | — | — | — | |
| InstructERCBackbone=ChatGPT-3.5, Evaluation Setting=Zero-shot2023.09 | 0.37 | — | — | — | — | — | — | |
| bc-LSTM# Param.=1.2M, features=roberta-large2023.06 | 0.3684 | — | — | — | — | — | 40.85 | |
| HiTrans2024.07 | 0.3675 | — | — | — | — | — | — | |
| DialogXL2023.04 | 0.3473 | — | — | — | — | — | — | |
| DialogXL+external_knowledge=true, features=roberta-large2023.06 | 0.3473 | — | — | — | — | — | — | |
| DialogXL2024.07 | 0.3473 | — | — | — | — | — | — | |
| DialogXLType=Conventional ERC2024.03 | 0.3473 | — | — | — | — | — | — | |
| DialogueGCN# Param.=2.1M, features=roberta-large2023.06 | 0.3463 | — | — | — | — | — | 36.87 | |
| RGAT2021.12 | 0.3442 | — | — | — | — | — | — | |
| RGAT2021.12 | 0.3442 | — | — | — | — | — | — | |
| RGATexternal_knowledge=true, features=roberta-large2023.06 | 0.3442 | — | — | — | — | — | — | |
| KET2019.09 | 0.3439 | — | — | — | — | — | — | |
| KET2021.12 | 0.3439 | — | — | — | — | — | — | |
| KET++external_knowledge=true, features=roberta-large2023.06 | 0.3439 | — | — | — | — | — | — | |
| KET2021.12 | 0.3395 | — | — | — | — | — | — | |
| KET_StdAttn2019.09 | 0.3353 | — | — | — | — | — | — | |
| BERT_BASE2019.09 | 0.3315 | — | — | — | — | — | — | |
| CNN+cLSTM2019.09 | 0.3289 | — | — | — | — | — | — | |
| CNN+cLSTM2021.12 | 0.3289 | — | — | — | — | — | — | |
| CNN2019.09 | 0.3259 | — | — | — | — | — | — | |
| CNN2021.12 | 0.3259 | — | — | — | — | — | — | |
| KET_SingleSelfAttn2019.09 | 0.3251 | — | — | — | — | — | — | |
| DialogueRNNSpeaker Selection=6 main + 1 universal2019.09 | 0.317 | — | — | — | — | — | — | |
| InstructERCBackbone=ChatGLM-6B, Evaluation Setting=LoRA Fine-tuned2023.09 | 0.3086 | — | — | — | — | — | — | |
| cLSTM2019.09 | 0.2601 | — | — | — | — | — | — | |
| LoRABackbone=ChatGLM-6B, Evaluation Setting=Fine-tuned2023.09 | 0.2571 | — | — | — | — | — | — | |
| InstructERCBackbone=ChatGLM2-6B, Evaluation Setting=Zero-shot2023.09 | 0.244 | — | — | — | — | — | — | |
| InstructERCBackbone=ChatGLM-6B, Evaluation Setting=Zero-shot2023.09 | 0.196 | — | — | — | — | — | — | |
| InstructERCBackbone=LLaMA2-7B, Evaluation Setting=Zero-shot2023.09 | 0.0836 | — | — | — | — | — | — | |
| InstructERCBackbone=LLaMA-7B, Evaluation Setting=Zero-shot2023.09 | 0.0531 | — | — | — | — | — | — | |
| APOLOBackbone=GPT-5-mini2026.01 | — | 0.4801 | — | — | — | — | — | |
| APOLOBackbone=DeepSeek-V32026.01 | — | 0.4655 | — | — | — | — | — | |
| APOLOBackbone=Qwen3-32B2026.01 | — | 0.4921 | — | — | — | — | — | |
| BERT2020.12 | — | — | — | — | — | 34.17 | — |