Multimodal Emotion Recognition on IEMOCAP Word Aligned (test)
90.7Happy AccuracyMulT
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| MulTAlignment=Word Aligned2019.06 | 90.7 | 88.6 | 86.7 | 86 | 87.4 | 87 | 72.4 | 70.7 | |
| Full modality (knowledge-transfer network)Available Modalities=Audio, Language, Vision, Alignment=Word Aligned2023.12 | 90.3 | 88.1 | 86.4 | 86 | 87.3 | 87 | 72.2 | 70.1 | |
| MFMAlignment=Word Aligned2019.06 | 90.2 | 85.8 | 88.4 | 86.1 | 87.5 | 86.7 | 72.1 | 68.1 | |
| MFMAlignment=Word Aligned2023.12 | 90.2 | 85.8 | 88.4 | 86.1 | 87.5 | 86.7 | 72.1 | 68.1 | |
| knowledge-transfer networkAlignment=Word Aligned, Description=Missing-audio scenario with reconstructed audio2023.12 | 90.1 | 87.6 | 87.5 | 85.5 | 87.2 | 86.8 | 71.9 | 70.1 | |
| Language and vision (knowledge-transfer network)Available Modalities=Language, Vision, Alignment=Word Aligned2023.12 | 89.1 | 86.8 | 85.9 | 85 | 86.1 | 85.2 | 70 | 69.4 | |
| RMFNAlignment=Word Aligned2019.06 | 87.5 | 85.8 | 83.8 | 82.9 | 85.1 | 84.6 | 69.5 | 69.1 | |
| RMFNAlignment=Word Aligned2023.12 | 87.5 | 85.8 | 83.8 | 82.9 | 85.1 | 84.6 | 69.5 | 69.1 | |
| EF-LSTMAlignment=Word Aligned2019.06 | 87.3 | 86 | 84.2 | 80.2 | 80.5 | 85.2 | 84.5 | 67.1 | |
| RAVENAlignment=Word Aligned2019.06 | 87.3 | 85.8 | 83.4 | 83.1 | 87.3 | 86.7 | 69.7 | 69.3 | |
| RAVENAlignment=Word Aligned2023.12 | 87.3 | 85.8 | 83.4 | 83.1 | 87.3 | 86.7 | 69.7 | 69.3 | |
| Language only (knowledge-transfer network)Available Modalities=Language, Alignment=Word Aligned2023.12 | 85.3 | 85.9 | 85.7 | 84.2 | 86.1 | 85.6 | 70.1 | 68.7 | |
| LF-LSTMAlignment=Word Aligned2019.06 | 85.1 | 86.3 | 78.9 | 81.7 | 84.7 | 83 | 67.1 | 67.6 | |
| MCTNAlignment=Word Aligned2019.06 | 84.9 | 83.1 | 80.5 | 79.6 | 79.7 | 80.4 | 62.3 | 57 | |
| MCTNAlignment=Word Aligned2023.12 | 84.9 | 83.1 | 80.5 | 79.6 | 79.7 | 80.4 | 62.3 | 57 | |
| Vision only (knowledge-transfer network)Available Modalities=Vision, Alignment=Word Aligned2023.12 | 83.7 | 81.6 | 81.5 | 81.2 | 82 | 81.3 | 63.2 | 62.7 |