Multimodal Sentiment Analysis on CMU-MOSI (test)
92.1F1ModalImmune
Evaluation results
| Method | Links | |||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ModalImmuneevaluation_protocol=full-modality2026.02 | 92.1 | — | — | 0.59 | 0.895 | 53.1 | 92.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MBDAvailable Modalities={t,a}2026.02 | 90 | — | — | — | — | 50.5 | 90 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| UMQsource=this paper2026.03 | 90 | — | — | 0.63 | 0.863 | 49.7 | 90.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CaMIBsource=original paper2026.01 | 89.8 | — | — | 0.616 | 0.857 | 48 | 89.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CaReFlowVenue=-2026.02 | 89.7 | — | — | 0.616 | 0.858 | 50.6 | 89.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MBDAvailable Modalities={t,v}2026.02 | 89.5 | — | — | — | — | 50 | 89.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| TEASELSentence Representation=RoBERTa2021.09 | 89.31 | — | — | 0.644 | 0.842 | 47.52 | 89.33 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| OMG-AgentModalities (L V A)=❍ ❍ ❍2026.02 | 89.1 | — | — | — | — | 48.3 | 89.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MOACsource=original paper2026.01 | 89 | — | — | 0.605 | 0.857 | 48.6 | 89 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MBDAvailable Modalities={t}2026.02 | 88.9 | — | — | — | — | 48.9 | 88.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DLFVenue=AAAI 20252026.02 | 88.6 | — | — | 0.669 | 0.856 | 49.4 | 88.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Shallow-FusionSentence Representation=RoBERTa2021.09 | 88.57 | — | — | 0.577 | — | 48.92 | 88.27 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AtCAFsource=original paper2026.01 | 88.5 | — | — | 0.65 | 0.831 | 46.5 | 88.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ITHPsource=our experiment2026.01 | 88.5 | — | — | 0.663 | 0.856 | 47.7 | 88.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GRCFsource=our experiment2026.01 | 88.5 | — | — | 0.581 | 0.866 | 49.3 | 90.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AtCAFVenue=Information Fusion 2025, Source=Original Paper2026.02 | 88.5 | — | — | 0.65 | 0.831 | 46.5 | 88.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ITHPVenue=ICLR 20242026.02 | 88.5 | — | — | 0.663 | 0.856 | 47.7 | 88.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AtCAFsource=original paper2026.03 | 88.5 | — | — | 0.65 | 0.831 | 46.5 | 88.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ITHPsource=re-experimented2026.03 | 88.5 | — | — | 0.663 | 0.856 | 47.7 | 88.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Multimodal Boostingsource=our experiment2026.01 | 88.4 | — | — | 0.634 | 0.855 | 49.1 | 88.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Multimodal BoostingVenue=TMM 20242026.02 | 88.4 | — | — | 0.634 | 0.855 | 49.1 | 88.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Multimodal Boostingsource=re-experimented2026.03 | 88.4 | — | — | 0.634 | 0.855 | 49.1 | 88.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MAG-XLNetSentence Representation=XLNet2021.09 | 87.9 | — | — | 0.675 | 0.821 | — | 87.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| C-MIBsource=our experiment2026.01 | 87.8 | — | — | 0.662 | 0.835 | 47.7 | 87.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| C-MIBVenue=TMM 20232026.02 | 87.8 | — | — | 0.662 | 0.835 | 47.7 | 87.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| C-MIBsource=re-experimented2026.03 | 87.8 | — | — | 0.662 | 0.835 | 47.7 | 87.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MSAmbaevaluation_protocol=full-modality2026.02 | 87.4 | — | — | 0.707 | 0.809 | 49.7 | 87.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| TMSONsource=original paper2026.01 | 87.2 | — | — | 0.687 | 0.809 | 47.4 | 87.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| OMG-AgentModalities (L V A)=❍ ❍ ✗2026.02 | 87.1 | — | — | — | — | 48 | 87.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| TRACE2026.06 | 87.04 | — | — | 0.7 | 0.81 | — | 87.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PAMoE-MSAevaluation_protocol=full-modality2026.02 | 87 | — | — | 0.69 | 0.806 | 48.7 | 87 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| roberta-largeSentence Representation=RoBERTa2021.09 | 86.91 | — | — | 0.687 | 0.835 | 46.65 | 86.89 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DBFBinary Split=No0, text_backbone=BART, vision_backbone=3D ResNeXt-1012023.05 | 86.9 | — | — | 0.693 | 0.801 | 44.8 | 86.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AlignMamba2024.12 | 86.9 | 86.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MGCLevaluation_protocol=full-modality2026.02 | 86.7 | — | — | 0.685 | 0.707 | 49.3 | 86.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| OMG-AgentModalities (L V A)=❍ ✗ ✗2026.02 | 86.6 | — | — | — | — | 45.3 | 86.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| OMG-AgentModalities (L V A)=❍ ✗ ❍2026.02 | 86.6 | — | — | — | — | 47.2 | 86.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MIAR2026.01 | 86.57 | — | — | — | — | 40.67 | 86.59 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| KuDAsource=original paper2026.01 | 86.5 | — | — | 0.705 | 0.795 | 47.1 | 86.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| FuseMoE2026.06 | 86.45 | — | — | 0.72 | 0.8 | — | 86.54 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AOBERT2024.12 | 86.4 | 85.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MoMKEAvailable Modalities={t,v}2026.02 | 86.4 | — | — | — | — | 37.5 | 86.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MoMKEAvailable Modalities={t,a}2026.02 | 86.4 | — | — | — | — | 38.6 | 86.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| UniMSEevaluation_protocol=full-modality2026.02 | 86.4 | — | — | 0.691 | 0.809 | 48.7 | 86.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GCL2026.05 | 86.4 | — | — | 0.685 | 0.812 | 49.06 | 86.79 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DEVAsource=original paper2026.01 | 86.3 | — | — | 0.73 | 0.787 | 46.3 | 86.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| HyDiscGANevaluation_protocol=full-modality2026.02 | 86.3 | — | — | 0.749 | 0.782 | 43.2 | 86.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CLGSIevaluation_protocol=full-modality2026.02 | 86.3 | — | — | 0.703 | 0.79 | 48 | 86.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DEVAVenue=AAAI 2025, Source=Original Paper2026.02 | 86.3 | — | — | 0.73 | 0.787 | 46.3 | 86.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DEVAsource=original paper2026.03 | 86.3 | — | — | 0.73 | 0.787 | 46.3 | 86.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| EUARAvailable Modalities={t,v}2026.02 | 86.2 | — | — | — | — | 45.5 | 86.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| TSDA2026.05 | 86.2 | — | — | 0.695 | 0.795 | 48.6 | 86.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MoMKEAvailable Modalities={t}2026.02 | 86.1 | — | — | — | — | 38.1 | 86.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| EUARAvailable Modalities={t,a}2026.02 | 86.1 | — | — | — | — | 44.7 | 86.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MMIMBinary Split=No02023.05 | 86 | — | — | 0.7 | 0.8 | 46.7 | 86.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MTMD2024.12 | 86 | 86 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MAG-BERTSentence Representation=BERT2021.09 | 86 | — | — | 0.739 | 0.796 | — | 86.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| EUARAvailable Modalities={t}2026.02 | 86 | — | — | — | — | 46.1 | 86 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MAG2026.06 | 86 | — | — | 0.71 | 0.8 | — | 86.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Self-MMSentence Representation=BERT2021.09 | 85.95 | — | — | 0.713 | 0.798 | — | 85.98 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DecAlign2025.03 | 85.82 | — | — | 0.735 | 0.811 | 45.07 | 85.75 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DMD2024.12 | 85.8 | 85.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AlignMambaMissing Rate=10%2024.12 | 85.6 | 85.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| IMDer2026.01 | 85.6 | — | — | — | — | 45.3 | 85.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DiCMoR2026.01 | 85.6 | — | — | — | — | 45.3 | 85.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Confede2024.12 | 85.5 | 85.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ConFEDEevaluation_protocol=full-modality2026.02 | 85.5 | — | — | 0.742 | 0.782 | 42.3 | 85.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| UniVL + MELTREnhancement=MELTR, Backbone=UniVL2023.03 | 85.4 | — | 85.3 | 0.759 | 0.789 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| IMDerAvailable Modalities={t,v}2026.02 | 85.4 | — | — | — | — | 45.3 | 85.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| EMOE2026.05 | 85.4 | — | — | 0.71 | — | 47.7 | 85.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| roberta-baseSentence Representation=RoBERTa2021.09 | 85.37 | — | — | 0.704 | 0.807 | 46.36 | 85.31 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| IMDerAvailable Modalities={t,a}2026.02 | 85.3 | — | — | — | — | 45 | 85.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BERTSentence Representation=BERT2021.09 | 85.2 | — | — | 0.739 | 0.782 | — | 85.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LNLNAvailable Modalities={t,a}2026.02 | 85.2 | — | — | — | — | 45.1 | 84.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DBFBinary Split=Has0, text_backbone=BART, vision_backbone=3D ResNeXt-1012023.05 | 85.1 | — | — | 0.693 | 0.801 | 44.8 | 85.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| HyCon2024.12 | 85.1 | 85.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GCNet2026.01 | 85.1 | — | — | — | — | 44.9 | 85.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| HyConevaluation_protocol=full-modality2026.02 | 85.1 | — | — | 0.741 | 0.779 | 46.6 | 85.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DLF2026.05 | 85.04 | — | — | 0.731 | 0.781 | 47.08 | 85.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MMIM2024.12 | 85 | 85.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DLFsource=original paper2026.01 | 85 | — | — | 0.731 | 0.781 | 47.1 | 85.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DLFevaluation_protocol=full-modality2026.02 | 85 | — | — | 0.731 | 0.781 | 47.1 | 85.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DLFsource=original paper2026.03 | 85 | — | — | 0.731 | 0.781 | 47.1 | 85.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Self-MMBinary Split=No02023.05 | 84.9 | — | — | 0.712 | 0.795 | 45.8 | 84.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Self-MM2024.12 | 84.9 | 84.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| IMDerMissing Rate=10%2024.12 | 84.8 | 84.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Self-MMsource=our experiment2026.01 | 84.8 | — | — | 0.731 | 0.785 | 45.8 | 84.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| EMOEsource=our experiment2026.01 | 84.8 | — | — | 0.723 | 0.79 | 45.2 | 84.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Self-MMVenue=AAAI 20212026.02 | 84.8 | — | — | 0.731 | 0.785 | 45.8 | 84.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| EMOEVenue=CVPR 20252026.02 | 84.8 | — | — | 0.723 | 0.79 | 45.2 | 84.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| FDMER2024.12 | 84.7 | 84.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| FDMER2026.01 | 84.7 | — | — | — | — | 44.1 | 84.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| IMDerAvailable Modalities={t}2026.02 | 84.7 | — | — | — | — | 44.8 | 84.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LNLNAvailable Modalities={t}2026.02 | 84.7 | — | — | — | — | 45.1 | 84.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| UniVL2023.03 | 84.6 | — | 84.6 | 0.781 | 0.767 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MAG-BERT2024.12 | 84.6 | 84.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LNLNAvailable Modalities={t,v}2026.02 | 84.6 | — | — | — | — | 44.6 | 84.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CM-BERT2024.12 | 84.5 | 84.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ULGM2024.12 | 84.5 | 84.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DEVA2026.05 | 84.45 | — | — | 0.73 | 0.787 | 46.33 | 84.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — |