Multimodal emotion recognition on MER 2023
90.36F1 ScoreEmotion-LLaMA
Evaluation results
| Method | Links | |
|---|---|---|
| Emotion-LLaMAModality=A, V, T2024.06 | 90.36 | |
| VATModality=A, V2024.06 | 89.11 | |
| Emotion-LLaMAModality=A, V2024.06 | 89.05 | |
| FBPModality=A, V, T2024.06 | 88.55 | |
| TransformerModality=A, V, T2024.06 | 88.53 | |
| MER2023-BaselineModality=A, V2024.06 | 86.75 | |
| MER2023-BaselineModality=A, V, T2024.06 | 86.4 | |
| HuBERTModality=A2024.06 | 85.11 | |
| BASELINE#PARAMS=7B2026.03 | 67.39 | |
| HyDRA#PARAMS=0.5B2026.03 | 65.69 | |
| BASELINE#PARAMS=0.5B2026.03 | 61.07 | |
| VideoMAEModality=V2024.06 | 60.68 | |
| R1-OMNI#PARAMS=0.5B2026.03 | 59.61 | |
| CHAT-UNIVI#PARAMS=7B2026.03 | 57.62 | |
| MPLUG-OWL#PARAMS=7B2026.03 | 56.86 | |
| MAEModality=V2024.06 | 55.47 | |
| AFFECTGPT#PARAMS=7B2026.03 | 55.23 | |
| VGGishModality=A2024.06 | 54.81 | |
| LLAMA-VID#PARAMS=7B2026.03 | 50.72 | |
| VIDEOCHAT#PARAMS=7B2026.03 | 48.73 | |
| MacBERTModality=T2024.06 | 46.32 | |
| VIDEO-CHATGPT#PARAMS=7B2026.03 | 44.86 | |
| BERTModality=T2024.06 | 43.6 | |
| ResNetModality=V2024.06 | 41.32 | |
| RoBERTaModality=T2024.06 | 40.61 | |
| wav2vec 2.0Modality=A2024.06 | 40.28 | |
| PANDAGPT#PARAMS=7B2026.03 | 40.21 | |
| VIDEO-LLAVA#PARAMS=7B2026.03 | 36.93 | |
| VIDEOCHAT2#PARAMS=7B2026.03 | 33.67 | |
| OTTER#PARAMS=7B2026.03 | 16.41 |