Multimodal Emotion Recognition on SAMSEMO
0.7794F1 ScoreWav2Vec 2.0 + Whisper + VE_MD DETR + Mixtral Feat.
Evaluation results
| Method | Links | |
|---|---|---|
| Wav2Vec 2.0 + Whisper + VE_MD DETR + Mixtral Feat.Year=2025, Modalities=A,V,T, Features=Pred. Body SR2026.05 | 0.7794 | |
| Wav2Vec 2.0 + Whisper + VE_MD DETR + Llama2 Feat.Year=2025, Modalities=A,V,T, Features=Pred. Body SR2026.05 | 0.7771 | |
| Wav2Vec 2.0 + Whisper + VE_MD DETRYear=2025, Modalities=A,V, Features=Pred. Body SR2026.05 | 0.7668 | |
| Whisper + VE_MD DETRYear=2025, Modalities=A,V, Features=Pred. Body SR2026.05 | 0.7497 | |
| Wav2Vec 2.0 + WhisperYear=2025, Modalities=A, Features=Acoustic + Content2026.05 | 0.7478 | |
| E2EYear=2024, Modalities=A,V,T, Features=–2026.05 | 0.69 | |
| E2EYear=2024, Modalities=V, Features=–2026.05 | 0.682 | |
| E2EYear=2024, Modalities=T, Features=–2026.05 | 0.63 | |
| E2EYear=2024, Modalities=A, Features=–2026.05 | 0.611 |