Multimodal Emotion Recognition on DFEW
68.8UAROmni-Emotion
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Omni-EmotionMethodology=multimodal LLM2026.05 | 68.8 | — | — | — | — | — | — | — | — | |
| Emotion-LLaMAEvaluation Protocol=Fine-tuning2024.06 | 64.21 | 93.05 | 79.42 | 72.47 | 84.14 | 72.79 | 3.15 | 44.2 | 77.06 | |
| VideoMAEEvaluation Protocol=Fine-tuning2024.06 | 63.6 | 93.09 | 78.78 | 71.75 | 78.74 | 63.44 | 17.93 | 41.46 | 74.6 | |
| MAE-DFEREvaluation Protocol=Fine-tuning2024.06 | 63.41 | 92.92 | 77.46 | 74.56 | 76.94 | 60.99 | 18.62 | 42.35 | 74.43 | |
| S2DEvaluation Protocol=Fine-tuning2024.06 | 61.82 | 93.62 | 80.25 | 77.14 | 81.09 | 64.53 | 1.38 | 34.71 | 76.03 | |
| IALEvaluation Protocol=Fine-tuning2024.06 | 55.71 | 87.95 | 67.21 | 70.1 | 76.06 | 62.22 | 0 | 26.44 | 69.24 | |
| Former-DFEREvaluation Protocol=Fine-tuning2024.06 | 53.69 | 84.05 | 62.57 | 67.52 | 70.03 | 56.43 | 3.45 | 31.78 | 65.7 | |
| GPT-4VEvaluation Protocol=Zero-Shot2024.06 | 47.69 | 62.35 | 70.45 | 56.18 | 50.69 | 32.19 | 10.34 | 51.11 | 54.85 | |
| Emotion-LLaMAEvaluation Protocol=Zero-Shot2024.06 | 45.59 | 71.98 | 76.25 | 61.99 | 71.95 | 33.67 | 0 | 3.31 | 59.37 | |
| Emotion-LLaMAMethodology=multimodal LLM2026.05 | 45.59 | — | — | — | — | — | — | — | 59.37 | |
| EC-STFIEvaluation Protocol=Fine-tuning2024.06 | 45.35 | 79.18 | 49.05 | 57.85 | 60.98 | 46.15 | 2.76 | 21.51 | 56.51 | |
| Video-LlamaEvaluation Protocol=Zero-Shot2024.06 | 26.77 | 20.25 | 67.55 | 80.15 | 5.29 | 4.76 | 0 | 9.39 | 35.75 | |
| Video-LLaVAEvaluation Protocol=Zero-Shot, Modality=video2024.06 | 26.17 | 51.94 | 39.84 | 29.78 | 58.85 | 0 | 0 | 2.76 | 35.24 | |
| MiniGPT-v2Evaluation Protocol=Zero-Shot2024.06 | 25.29 | 84.25 | 47.23 | 22.28 | 20.69 | 2.04 | 0 | 0.55 | 34.47 | |
| Qwen-AudioEvaluation Protocol=Zero-Shot2024.06 | 25.23 | 25.97 | 12.93 | 67.04 | 29.2 | 6.12 | 0 | 35.36 | 31.74 | |
| LLaVA-NEXTEvaluation Protocol=Zero-Shot2024.06 | 25.12 | 57.46 | 79.42 | 38.95 | 0 | 0 | 0 | 0 | 33.75 | |
| Video-LLaVAEvaluation Protocol=Zero-Shot, Modality=image2024.06 | 20.78 | 37.09 | 27.18 | 26.97 | 58.85 | 12.97 | 0 | 3.31 | 31.1 |