Emotion Recognition on CMU-MOSEI (test)
54.6Accuracy (7)DMD
Evaluation results
| Method | Links | |||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| DMDSetting=Unaligned, BERT-based language features=false2023.03 | 54.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 84.8 | 84.7 | |
| DMDSetting=Aligned, BERT-based language features=true2023.03 | 54.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 86.6 | 86.6 | |
| FDMERSetting=Aligned, BERT-based language features=true2023.03 | 54.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 86.1 | 85.8 | |
| DMDSetting=Aligned, BERT-based language features=false2023.03 | 53.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 85 | 84.9 | |
| PMRSetting=Aligned, BERT-based language features=false2023.03 | 52.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 83.3 | 82.6 | |
| MICASetting=Unaligned, BERT-based language features=false2023.03 | 52.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 83.7 | 83.3 | |
| MISASetting=Aligned, BERT-based language features=true2023.03 | 52.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 85.5 | 85.3 | |
| MulTSetting=Aligned, BERT-based language features=false2023.03 | 51.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 82.5 | 82.3 | |
| PMRSetting=Unaligned, BERT-based language features=false2023.03 | 51.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 83.1 | 82.8 | |
| MulTSetting=Unaligned, BERT-based language features=false2023.03 | 50.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 81.6 | 81.6 | |
| RAVENSetting=Aligned, BERT-based language features=false2023.03 | 50 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 79.1 | 79.5 | |
| MCTNSetting=Aligned, BERT-based language features=false2023.03 | 49.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 79.8 | 80.6 | |
| LF-LSTMSetting=Aligned, BERT-based language features=false2023.03 | 48.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 80.6 | 80.6 | |
| LF-LSTMSetting=Unaligned, BERT-based language features=false2023.03 | 48.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 77.5 | 78.2 | |
| MCTNSetting=Unaligned, BERT-based language features=false2023.03 | 48.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 79.3 | 79.7 | |
| EF-LSTMSetting=Aligned, BERT-based language features=false2023.03 | 47.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 78.2 | 77.9 | |
| EF-LSTMSetting=Unaligned, BERT-based language features=false2023.03 | 46.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 76.1 | 75.9 | |
| RAVENSetting=Unaligned, BERT-based language features=false2023.03 | 45.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 75.4 | 75.7 | |
| Graph-MFNSetting=Aligned, BERT-based language features=false2023.03 | 45 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 76.9 | 77 | |
| COGMENModality=T2022.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | 69.28 | 70.49 | 73.04 | 87.8 | 83.69 | 85.83 | — | — | |
| COGMENModality=A+T2022.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | 68.39 | 73.28 | 74.98 | 88.08 | 83.9 | 85.35 | — | — | |
| COGMENModality=T+A+V2022.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | 70.42 | 72.31 | 76.2 | 88.17 | 83.69 | 85.28 | — | — | |
| COGMENModality=T2022.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | 69.92 | 72.16 | 77.34 | 86.39 | 86 | 88.27 | — | — | |
| COGMENModality=A+T2022.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | 69.62 | 72.67 | 76.93 | 86.39 | 85.35 | 88.21 | — | — | |
| COGMENModality=T+A+V2022.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | 72.74 | 73.9 | 78.04 | 86.71 | 85.48 | 88.37 | — | — | |
| G-MFNModality=not specified2020.06 | — | — | 66.3 | — | 66.9 | — | 72.8 | — | 89.9 | — | 76.6 | — | 85.5 | — | — | — | — | — | — | — | — | |
| Graph-MFN2020.10 | — | 66 | — | 67 | — | 73 | — | 79 | — | 77 | — | 85 | — | — | — | — | — | — | — | — | — | |
| MAT2020.10 | — | 66 | — | 75 | — | 75 | — | 91 | — | 84 | — | 89 | — | — | — | — | — | — | — | — | — | |
| MNT2020.10 | — | 66 | — | 76 | — | 77 | — | 92 | — | 85 | — | 91 | — | — | — | — | — | — | — | — | — | |
| Mu-NetModality=not specified2020.06 | — | — | 68.4 | — | 74.5 | — | 80.9 | — | 87 | — | 87.3 | — | 80.9 | — | — | — | — | — | — | — | — | |
| Multilogue-Net2020.10 | — | 68 | — | 75 | — | 81 | — | 87 | — | 87 | — | 81 | — | — | — | — | — | — | — | — | — | |
| Multilogue-NetModality=T+A+V2022.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | 67.84 | 65.34 | 67.03 | 87.79 | 74.91 | 86.05 | — | — | |
| Multilogue-NetModality=T+A+V2022.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | 70.6 | 70.7 | 74.4 | 86 | 83.4 | 87.8 | — | — | |
| NT2020.10 | — | 65 | — | 75 | — | 74 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| P2020.10 | — | — | — | — | — | — | — | 88 | — | 84 | — | 86 | — | — | — | — | — | — | — | — | — | |
| TBJEModality=L + A + V2020.06 | — | 65 | 64 | 72 | 67.9 | 81.6 | 74.7 | 89.1 | 84 | 85.9 | 83.6 | 90.5 | 86.1 | — | — | — | — | — | — | — | — | |
| TBJEModality=L + A2020.06 | — | 66 | 65.5 | 73.9 | 67.9 | 81.9 | 76 | 89.2 | 87.2 | 86.5 | 84.5 | 90.6 | 86.1 | — | — | — | — | — | — | — | — | |
| TBJEModality=L2020.06 | — | 64.5 | 63.4 | 72.9 | 65.8 | 81.4 | 75.3 | 89.1 | 84 | 86.6 | 84.5 | 90.5 | 81.4 | — | — | — | — | — | — | — | — | |
| TBJEModality=T2022.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 63.4 | 65.8 | 75.3 | 84 | 84.5 | — | — | |
| TBJEModality=A+T2022.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | 65.91 | 64 | 67.9 | 74.7 | 84 | 83.6 | — | — | |
| TBJEModality=T2022.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | 65.5 | 67.9 | 76 | 87.2 | 84.5 | 86.1 | — | — |