Multimodal Emotion Recognition in Conversation on MELD
69Weighted Avg F1 ScoreGS-MCC
Evaluation results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GS-MCCParameters=2.10M2024.04 | 69 | 78.4 | 81.8 | 56.9 | 58.3 | 23.5 | 23.8 | 50 | 35.8 | 69.4 | 66.4 | 36.7 | 30.7 | 53.2 | 54.4 | 68.1 | |
| SUREMethod Category=Fusion-based Methods2026.04 | 67.36 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 67.97 | |
| DF-ERCMethod Category=Fusion-based Methods2026.04 | 67.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 68.28 | |
| AdaGINParameters=6.3M2024.04 | 66.8 | 79.8 | — | 60.5 | — | 15.2 | — | 43.7 | — | 64.5 | — | 29.3 | — | 56.2 | — | 67.6 | |
| SDTMethod Category=Fusion-based Methods2026.04 | 66.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 67.55 | |
| DER-GCNParameters=78.59M2024.04 | 66.1 | 76.8 | 80.6 | 50.5 | 51 | 14.8 | 10.4 | 56.7 | 41.5 | 69.3 | 64.3 | 17.2 | 10.3 | 52.5 | 57.4 | 66.8 | |
| MM-NodeFormerMethod Category=Fusion-based Methods2026.04 | 66.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 67.86 | |
| LR-GCNParameters=15.77M2024.04 | 65.6 | 76.7 | 80 | 53.3 | 55.2 | 0 | 0 | 49.6 | 35.1 | 68 | 64.4 | 10.7 | 2.7 | 48 | 51 | 65.7 | |
| CoMPM2024.04 | 65.3 | 78.3 | 82 | 48.3 | 49.2 | 1.7 | 2.9 | 35.9 | 32.3 | 71.4 | 61.5 | 3.1 | 2.8 | 42.2 | 45.8 | 64.1 | |
| EmoBERTaParameters=499M2024.04 | 65.2 | 78.9 | 82.5 | 50.2 | 50.2 | 1.8 | 1.9 | 33.3 | 31.2 | 72.1 | 61.7 | 9.1 | 2.5 | 43.3 | 46.4 | 64.1 | |
| DialogueTRMMethod Category=Fusion-based Methods2026.04 | 63.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 65.7 | |
| MERC-GCNMethod Category=Graph-based Methods2026.04 | 62.54 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| JoyfulMethod Category=Graph-based Methods2026.04 | 61.77 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 62.53 | |
| RGATParameters=15.28M2024.04 | 61.1 | 76 | 78.1 | 40.1 | 41.5 | 3 | 2.4 | 32.1 | 30.7 | 68.1 | 58.6 | 4.5 | 2.2 | 40 | 44.6 | 60.3 | |
| A-DMN2024.04 | 60.4 | 76.5 | 78.9 | 56.2 | 55.3 | 8.2 | 8.6 | 22.1 | 24.9 | 59.8 | 57.4 | 1.2 | 3.4 | 41.3 | 40.9 | 61.5 | |
| MM-DFNMethod Category=Graph-based Methods2026.04 | 59.46 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 62.49 | |
| MM-GCNParameters=0.46M2024.04 | 59.4 | 64.8 | 77.1 | 67.4 | 53.9 | 0 | 0 | 72.4 | 17.7 | 68.7 | 56.9 | 11.1 | 0 | 54.4 | 42.6 | 64.4 | |
| MMPCGNMethod Category=Graph-based Methods2026.04 | 59.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 60.7 | |
| AffectAgentModality=A, V, T, Backbone=AffectGPT2026.04 | 59.07 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MMGCNMethod Category=Graph-based Methods2026.04 | 58.31 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 60.42 | |
| bc-LSTMParameters=1.28M2024.04 | 55.9 | 78.4 | 73.8 | 46.8 | 47.7 | 3.8 | 5.4 | 22.4 | 25.1 | 51.6 | 51.3 | 4.3 | 5.2 | 36.7 | 38.4 | 57.5 | |
| DialogueRNNParameters=14.47M2024.04 | 55.9 | 72.1 | 73.5 | 54.4 | 49.4 | 1.6 | 1.2 | 23.9 | 23.8 | 52 | 50.7 | 1.5 | 1.7 | 41 | 41.5 | 56.1 | |
| AffectGPTModality=A, V, T2026.04 | 55.65 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DialogueGCNParameters=12.92M2024.04 | 54.7 | 70.3 | 72.1 | 42.4 | 41.7 | 3 | 2.8 | 20.9 | 21.8 | 44.7 | 44.2 | 6.5 | 6.7 | 39 | 36.5 | 54.9 | |
| AffectAgentModality=A, V, T, Backbone=Emotion-LLaMA2026.04 | 52.38 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Emotion-LLaMAModality=A, V, T2026.04 | 46.76 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AffectAgentModality=A, V, T, Backbone=PandaGPT2026.04 | 45.29 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PandaGPTModality=A, V, T2026.04 | 37.88 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AffectAgentModality=A, V, T, Backbone=Video-LLaMA 22026.04 | 29.41 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AffectAgentModality=A, V, T, Backbone=ChatBridge2026.04 | 28.39 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AffectAgentModality=A, V, T, Backbone=VideoChat2026.04 | 25.38 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AffectAgentModality=A, V, T, Backbone=Video-LLaMA2026.04 | 24.07 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Video-LLaMA 2Modality=A, V, T2026.04 | 22.08 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ChatBridgeModality=A, V, T2026.04 | 20.35 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| VideoChatModality=A, V, T2026.04 | 19.55 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Video-LLaMAModality=A, V, T2026.04 | 17.65 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — |