Multimodal Emotion Recognition on IEMOCAP 6-way
71.03F1 (Avg)JOYFUL
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| JOYFULModality=A+T+V2023.11 | 71.03 | 60.94 | 84.42 | 68.24 | 69.95 | 73.54 | 67.55 | 70.55 | |
| Lian et al.Modality=Audio+Text2023.04 | 70.5 | — | — | — | — | — | — | — | |
| HCAMModality=Audio+Text2023.04 | 70.5 | — | — | — | — | — | — | — | |
| Mao et al.Modality=Audio+Text2023.04 | 69.7 | — | — | — | — | — | — | — | |
| Li et al.Modality=Audio+Text, implementation=re-implemented by current paper authors2023.04 | 69.3 | — | — | — | — | — | — | — | |
| MMDFN+BALMIMR configuration (rA, rL, rV)=(0.5,0.3,0.7)2026.03 | 68.25 | — | — | — | — | — | — | 68.76 | |
| COGMENModality=A+T+V2023.11 | 67.63 | 51.91 | 81.72 | 68.61 | 66.02 | 75.31 | 58.23 | 68.26 | |
| COGMENModality=A+T+V2022.05 | 67.6 | 51.9 | 81.7 | 68.6 | 66 | 75.3 | 58.2 | 68.2 | |
| MMDFNIMR configuration (rA, rL, rV)=(0.5,0.3,0.7)2026.03 | 67.4 | — | — | — | — | — | — | 67.34 | |
| MMDFN+BALMIMR configuration (rA, rL, rV)=(0.7,0.3,0.5)2026.03 | 67.02 | — | — | — | — | — | — | 67.22 | |
| MMDFNIMR configuration (rA, rL, rV)=(0.7,0.3,0.5)2026.03 | 66.67 | — | — | — | — | — | — | 66.48 | |
| MMDFN+BALMIMR configuration (rA, rL, rV)=(0.3,0.5,0.7)2026.03 | 66.64 | — | — | — | — | — | — | 67.34 | |
| Shen et al.Modality=Audio+Text2023.04 | 65.9 | — | — | — | — | — | — | — | |
| HCAMModality=Audio2023.04 | 65.7 | — | — | — | — | — | — | — | |
| COSMICModality=A+T+V2023.11 | 65.38 | 53.23 | 78.43 | 62.08 | 65.87 | 69.6 | 61.39 | 64.88 | |
| RGATModality=A+T+V2023.11 | 65.22 | 51.62 | 77.32 | 65.42 | 63.01 | 67.95 | 61.23 | 65.55 | |
| MMGCN+BALMIMR configuration (rA, rL, rV)=(0.5,0.3,0.7)2026.03 | 65.03 | — | — | — | — | — | — | 65.37 | |
| MMGCN+BALMIMR configuration (rA, rL, rV)=(0.7,0.3,0.5)2026.03 | 64.98 | — | — | — | — | — | — | 65 | |
| MMDFN+BALMIMR configuration (rA, rL, rV)=(0.7,0.5,0.3)2026.03 | 64.98 | — | — | — | — | — | — | 65.5 | |
| MMGCNIMR configuration (rA, rL, rV)=(0.5,0.3,0.7)2026.03 | 64.95 | — | — | — | — | — | — | 64.63 | |
| HCAMModality=Text2023.04 | 64.4 | — | — | — | — | — | — | — | |
| MMGCNIMR configuration (rA, rL, rV)=(0.7,0.3,0.5)2026.03 | 64.27 | — | — | — | — | — | — | 64.14 | |
| Ghosal et al.Modality=Audio+Text2023.04 | 64.2 | — | — | — | — | — | — | — | |
| MMDFNIMR configuration (rA, rL, rV)=(0.7,0.5,0.3)2026.03 | 64 | — | — | — | — | — | — | 63.65 | |
| MMGCN+BALMIMR configuration (rA, rL, rV)=(0.3,0.5,0.7)2026.03 | 63.82 | — | — | — | — | — | — | 64.39 | |
| MMDFN+BALMIMR configuration (rA, rL, rV)=(0.5,0.7,0.3)2026.03 | 63.76 | — | — | — | — | — | — | 64.02 | |
| Af-CANModality=A+T+V2023.11 | 63.74 | 37.01 | 72.13 | 60.72 | 67.34 | 66.51 | 66.13 | 64.62 | |
| Af-CANModality=A+T+V2022.05 | 63.7 | 37 | 72.1 | 60.7 | 67.3 | 66.5 | 66.1 | 64.6 | |
| MMGCNIMR configuration (rA, rL, rV)=(0.3,0.5,0.7)2026.03 | 63.62 | — | — | — | — | — | — | 63.59 | |
| AGHMNModality=A+T+V2023.11 | 63.54 | 52.1 | 73.3 | 58.4 | 61.91 | 69.72 | 62.31 | 63.58 | |
| ICONModality=A+T+V2022.05 | 63.5 | 32.8 | 74.4 | 60.6 | 68.2 | 68.4 | 66.2 | 64 | |
| MMDFN+BALMIMR configuration (rA, rL, rV)=(0.3,0.7,0.5)2026.03 | 63.11 | — | — | — | — | — | — | 63.4 | |
| MMDFNIMR configuration (rA, rL, rV)=(0.3,0.5,0.7)2026.03 | 63 | — | — | — | — | — | — | 63.34 | |
| DiaRNNModality=A+T+V2023.11 | 62.85 | 32.88 | 78.08 | 59.11 | 63.38 | 73.66 | 59.41 | 63.34 | |
| DialogueRNNModality=A+T+V2022.05 | 62.8 | 32.8 | 78 | 59.1 | 63.3 | 73.6 | 59.4 | 63.3 | |
| Majumder et al.Modality=Audio+Text2023.04 | 62.8 | — | — | — | — | — | — | — | |
| CANModality=A+T+V2022.05 | 62.4 | 31.8 | 71.9 | 60.4 | 66.7 | 68.5 | 66.1 | 63.2 | |
| MMGCN+BALMIMR configuration (rA, rL, rV)=(0.5,0.7,0.3)2026.03 | 62.35 | — | — | — | — | — | — | 62.29 | |
| GCNetIMR configuration (rA, rL, rV)=(0.5,0.3,0.7)2026.03 | 62.06 | — | — | — | — | — | — | 61.61 | |
| GCNet+BALMIMR configuration (rA, rL, rV)=(0.5,0.3,0.7)2026.03 | 61.62 | — | — | — | — | — | — | 61.31 | |
| Ada2IIMR configuration (rA, rL, rV)=(0.3,0.7,0.5)2026.03 | 61.46 | — | — | — | — | — | — | 61.98 | |
| CMNModality=A+T+V2022.05 | 61.4 | 32.6 | 72.9 | 56.2 | 64.6 | 67.9 | 63.1 | 61.9 | |
| GCNet+BALMIMR configuration (rA, rL, rV)=(0.3,0.5,0.7)2026.03 | 61.33 | — | — | — | — | — | — | 61.31 | |
| MMGCN+BALMIMR configuration (rA, rL, rV)=(0.7,0.5,0.3)2026.03 | 61.2 | — | — | — | — | — | — | 61.74 | |
| Ada2IIMR configuration (rA, rL, rV)=(0.7,0.3,0.5)2026.03 | 60.9 | — | — | — | — | — | — | 61.74 | |
| MMGCNIMR configuration (rA, rL, rV)=(0.7,0.5,0.3)2026.03 | 60.85 | — | — | — | — | — | — | 60.63 | |
| Ada2IIMR configuration (rA, rL, rV)=(0.3,0.5,0.7)2026.03 | 60.68 | — | — | — | — | — | — | 61.98 | |
| GCNet+BALMIMR configuration (rA, rL, rV)=(0.7,0.5,0.3)2026.03 | 60.58 | — | — | — | — | — | — | 60.26 | |
| Ada2IIMR configuration (rA, rL, rV)=(0.5,0.3,0.7)2026.03 | 60.45 | — | — | — | — | — | — | 61.37 | |
| Mi-CGAIMR configuration (rA, rL, rV)=(0.5,0.3,0.7)2026.03 | 60.25 | — | — | — | — | — | — | 60.5 | |
| MMGCN+BALMIMR configuration (rA, rL, rV)=(0.3,0.7,0.5)2026.03 | 60.04 | — | — | — | — | — | — | 60.07 | |
| MMDFNIMR configuration (rA, rL, rV)=(0.3,0.7,0.5)2026.03 | 60.01 | — | — | — | — | — | — | 60.38 | |
| MoMKEIMR configuration (rA, rL, rV)=(0.5,0.3,0.7)2026.03 | 59.94 | — | — | — | — | — | — | 60.18 | |
| MFNModality=A+T+V2022.05 | 59.9 | 34.1 | 70.5 | 52.1 | 66.8 | 62.1 | 62.5 | 60.1 | |
| GCNetIMR configuration (rA, rL, rV)=(0.7,0.3,0.5)2026.03 | 59.78 | — | — | — | — | — | — | 59.64 | |
| memnetModality=A+T+V2022.05 | 59.5 | 33 | 69.3 | 55 | 66.1 | 62.3 | 63 | 59.9 | |
| GCNet+BALMIMR configuration (rA, rL, rV)=(0.7,0.3,0.5)2026.03 | 59.39 | — | — | — | — | — | — | 59.33 | |
| SDR-GNNIMR configuration (rA, rL, rV)=(0.3,0.5,0.7)2026.03 | 59.34 | — | — | — | — | — | — | 59.46 | |
| GCNetIMR configuration (rA, rL, rV)=(0.7,0.5,0.3)2026.03 | 59.19 | — | — | — | — | — | — | 59.09 | |
| bc-LSTMModality=A+T+V2022.05 | 59 | 35.6 | 69.2 | 53.5 | 66.3 | 61.1 | 62.4 | 59.8 | |
| MMGCNIMR configuration (rA, rL, rV)=(0.3,0.7,0.5)2026.03 | 58.99 | — | — | — | — | — | — | 59.09 | |
| Mi-CGAIMR configuration (rA, rL, rV)=(0.3,0.5,0.7)2026.03 | 58.8 | — | — | — | — | — | — | 58.84 | |
| Mi-CGAIMR configuration (rA, rL, rV)=(0.7,0.3,0.5)2026.03 | 58.63 | — | — | — | — | — | — | 58.84 | |
| TFNModality=A+T+V2022.05 | 58.5 | 33.7 | 68.6 | 55.1 | 64.2 | 62.4 | 61.2 | 58.8 | |
| MoMKEIMR configuration (rA, rL, rV)=(0.7,0.3,0.5)2026.03 | 58.45 | — | — | — | — | — | — | 58.26 | |
| SDR-GNNIMR configuration (rA, rL, rV)=(0.5,0.3,0.7)2026.03 | 58.42 | — | — | — | — | — | — | 58.53 | |
| GCNetIMR configuration (rA, rL, rV)=(0.3,0.5,0.7)2026.03 | 58.36 | — | — | — | — | — | — | 58.04 | |
| Mi-CGAIMR configuration (rA, rL, rV)=(0.7,0.5,0.3)2026.03 | 58.22 | — | — | — | — | — | — | 58.72 | |
| Ada2IIMR configuration (rA, rL, rV)=(0.5,0.7,0.3)2026.03 | 58.22 | — | — | — | — | — | — | 58.1 | |
| MultModality=A+T+V2023.11 | 58.1 | 48.23 | 76.54 | 52.38 | 60.04 | 54.71 | 57.51 | 58.04 | |
| MMGCNIMR configuration (rA, rL, rV)=(0.5,0.7,0.3)2026.03 | 57.99 | — | — | — | — | — | — | 57.79 | |
| FE2EModality=A+T+V2023.11 | 57.69 | 44.82 | 64.98 | 56.09 | 62.12 | 61.02 | 57.14 | 58.3 | |
| GCNet+BALMIMR configuration (rA, rL, rV)=(0.5,0.7,0.3)2026.03 | 57.64 | — | — | — | — | — | — | 57.64 | |
| GCNet+BALMIMR configuration (rA, rL, rV)=(0.3,0.7,0.5)2026.03 | 57 | — | — | — | — | — | — | 57.36 | |
| GCNetIMR configuration (rA, rL, rV)=(0.5,0.7,0.3)2026.03 | 56.99 | — | — | — | — | — | — | 56.81 | |
| GCNetIMR configuration (rA, rL, rV)=(0.3,0.7,0.5)2026.03 | 56.83 | — | — | — | — | — | — | 56.81 | |
| SDR-GNNIMR configuration (rA, rL, rV)=(0.5,0.7,0.3)2026.03 | 56.77 | — | — | — | — | — | — | 56.56 | |
| MMDFNIMR configuration (rA, rL, rV)=(0.5,0.7,0.3)2026.03 | 56.25 | — | — | — | — | — | — | 57.92 | |
| Mi-CGAIMR configuration (rA, rL, rV)=(0.5,0.7,0.3)2026.03 | 56.11 | — | — | — | — | — | — | 56.19 | |
| SDR-GNNIMR configuration (rA, rL, rV)=(0.7,0.3,0.5)2026.03 | 55.22 | — | — | — | — | — | — | 55.14 | |
| SDR-GNNIMR configuration (rA, rL, rV)=(0.7,0.5,0.3)2026.03 | 55.17 | — | — | — | — | — | — | 55.45 | |
| MoMKEIMR configuration (rA, rL, rV)=(0.7,0.5,0.3)2026.03 | 54.92 | — | — | — | — | — | — | 54.78 | |
| Ada2IIMR configuration (rA, rL, rV)=(0.7,0.5,0.3)2026.03 | 54.76 | — | — | — | — | — | — | 57.73 | |
| Mi-CGAIMR configuration (rA, rL, rV)=(0.3,0.7,0.5)2026.03 | 54.61 | — | — | — | — | — | — | 54.65 | |
| MoMKEIMR configuration (rA, rL, rV)=(0.3,0.5,0.7)2026.03 | 54.19 | — | — | — | — | — | — | 55.39 | |
| SDR-GNNIMR configuration (rA, rL, rV)=(0.3,0.7,0.5)2026.03 | 53.59 | — | — | — | — | — | — | 54.16 | |
| RedCoreIMR configuration (rA, rL, rV)=(0.7,0.3,0.5)2026.03 | 50.53 | — | — | — | — | — | — | 50.59 | |
| MMINIMR configuration (rA, rL, rV)=(0.5,0.3,0.7)2026.03 | 50.28 | — | — | — | — | — | — | 56.4 | |
| MoMKEIMR configuration (rA, rL, rV)=(0.5,0.7,0.3)2026.03 | 50.15 | — | — | — | — | — | — | 50.77 | |
| MMINIMR configuration (rA, rL, rV)=(0.3,0.5,0.7)2026.03 | 49.92 | — | — | — | — | — | — | 55.97 | |
| MMINIMR configuration (rA, rL, rV)=(0.7,0.3,0.5)2026.03 | 49.85 | — | — | — | — | — | — | 55.87 | |
| MMINIMR configuration (rA, rL, rV)=(0.3,0.7,0.5)2026.03 | 49.83 | — | — | — | — | — | — | 55.87 | |
| MMINIMR configuration (rA, rL, rV)=(0.5,0.7,0.3)2026.03 | 49.75 | — | — | — | — | — | — | 55.87 | |
| MMINIMR configuration (rA, rL, rV)=(0.7,0.5,0.3)2026.03 | 49.73 | — | — | — | — | — | — | 55.83 | |
| MoMKEIMR configuration (rA, rL, rV)=(0.3,0.7,0.5)2026.03 | 49.7 | — | — | — | — | — | — | 50.83 | |
| MCEIMR configuration (rA, rL, rV)=(0.7,0.3,0.5)2026.03 | 49.45 | — | — | — | — | — | — | 50.34 | |
| MCEIMR configuration (rA, rL, rV)=(0.5,0.3,0.7)2026.03 | 49.22 | — | — | — | — | — | — | 50.65 | |
| RedCoreIMR configuration (rA, rL, rV)=(0.5,0.3,0.7)2026.03 | 47.92 | — | — | — | — | — | — | 50.15 | |
| RedCoreIMR configuration (rA, rL, rV)=(0.3,0.5,0.7)2026.03 | 46.32 | — | — | — | — | — | — | 46.27 | |
| RedCoreIMR configuration (rA, rL, rV)=(0.7,0.5,0.3)2026.03 | 46.21 | — | — | — | — | — | — | 46.09 |