Multimodal Sentiment Analysis on CMU-MOSEI (test)
91.7F1 ScoreModalImmune
Evaluation results
| Method | Links | ||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ModalImmuneevaluation_protocol=full-modality2026.02 | 91.7 | — | 91.7 | — | 59 | 85.9 | — | — | — | — | — | — | — | — | 0.448 | — | — | — | — | — | |
| GRCFsource=our experiment2026.01 | 91.5 | — | 89.1 | — | 58.7 | 83.5 | — | — | — | — | — | — | — | — | 0.46 | — | — | — | — | — | |
| UMQsource=this paper2026.03 | 88.1 | — | 88.1 | — | 55.5 | 79.6 | — | — | — | — | — | — | — | — | 0.506 | — | — | — | — | — | |
| CaReFlowVenue=-2026.02 | 88 | — | 87.9 | — | 55.7 | 79.9 | — | — | — | — | — | — | — | — | 0.504 | — | — | — | — | — | |
| MOACsource=original paper2026.01 | 87.6 | — | 87.6 | — | 54.3 | 79.3 | — | — | — | — | — | — | — | — | 0.512 | — | — | — | — | — | |
| UniMSEevaluation_protocol=full-modality2026.02 | 87.5 | — | 87.5 | — | 54.4 | 77.3 | — | — | — | — | — | — | — | — | 0.523 | — | — | — | — | — | |
| OMG-AgentModalities (L V A)=❍ ❍ ❍2026.02 | 87.4 | — | 87.3 | — | 56.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DLFVenue=AAAI 20252026.02 | 87.4 | — | 87.5 | — | 55 | 77.4 | — | — | — | — | — | — | — | — | 0.515 | — | — | — | — | — | |
| CaMIBsource=original paper2026.01 | 87.2 | — | 87.3 | — | 53.5 | 78.8 | — | — | — | — | — | — | — | — | 0.517 | — | — | — | — | — | |
| OMG-AgentModalities (L V A)=❍ ✗ ✗2026.02 | 87.1 | — | 87.3 | — | 53.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ITHPsource=our experiment2026.01 | 87.1 | — | 87.1 | — | 52.2 | 79.2 | — | — | — | — | — | — | — | — | 0.55 | — | — | — | — | — | |
| ITHPVenue=ICLR 20242026.02 | 87.1 | — | 87.1 | — | 52.2 | 79.2 | — | — | — | — | — | — | — | — | 0.55 | — | — | — | — | — | |
| ITHPsource=re-experimented2026.03 | 87.1 | — | 87.1 | — | 52.2 | 79.2 | — | — | — | — | — | — | — | — | 0.55 | — | — | — | — | — | |
| PAMoE-MSAevaluation_protocol=full-modality2026.02 | 86.9 | — | 87.7 | — | 54.6 | 78 | — | — | — | — | — | — | — | — | 0.526 | — | — | — | — | — | |
| MSAmbaevaluation_protocol=full-modality2026.02 | 86.9 | — | 86.9 | — | 54.2 | 79.6 | — | — | — | — | — | — | — | — | 0.507 | — | — | — | — | — | |
| AtCAFsource=original paper2026.01 | 86.8 | — | 87 | — | 55.9 | 78.5 | — | — | — | — | — | — | — | — | 0.508 | — | — | — | — | — | |
| C-MIBsource=our experiment2026.01 | 86.8 | — | 86.9 | — | 52.7 | 78.4 | — | — | — | — | — | — | — | — | 0.542 | — | — | — | — | — | |
| C-MIBVenue=TMM 20232026.02 | 86.8 | — | 86.9 | — | 52.7 | 78.4 | — | — | — | — | — | — | — | — | 0.542 | — | — | — | — | — | |
| AtCAFVenue=Information Fusion 2025, Source=Original Paper2026.02 | 86.8 | — | 87 | — | 55.9 | 78.5 | — | — | — | — | — | — | — | — | 0.508 | — | — | — | — | — | |
| AtCAFsource=original paper2026.03 | 86.8 | — | 87 | — | 55.9 | 78.5 | — | — | — | — | — | — | — | — | 0.508 | — | — | — | — | — | |
| C-MIBsource=re-experimented2026.03 | 86.8 | — | 86.9 | — | 52.7 | 78.4 | — | — | — | — | — | — | — | — | 0.542 | — | — | — | — | — | |
| OMG-AgentModalities (L V A)=❍ ✗ ❍2026.02 | 86.7 | — | 86.4 | — | 53.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| KuDAsource=original paper2026.01 | 86.6 | — | 86.5 | — | 52.9 | 77.6 | — | — | — | — | — | — | — | — | 0.529 | — | — | — | — | — | |
| GCL2026.05 | 86.55 | — | 86.78 | — | 55.36 | 78.5 | — | — | — | — | — | — | — | — | 0.52 | — | — | — | — | — | |
| AlignMamba2024.12 | 86.5 | — | — | — | — | — | — | — | — | — | — | — | 86.6 | — | — | — | — | — | — | — | |
| OMG-AgentModalities (L V A)=❍ ❍ ✗2026.02 | 86.5 | — | 86.3 | — | 54.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Multimodal Boostingsource=our experiment2026.01 | 86.5 | — | 86.5 | — | 54 | 77.9 | — | — | — | — | — | — | — | — | 0.523 | — | — | — | — | — | |
| Multimodal BoostingVenue=TMM 20242026.02 | 86.5 | — | 86.5 | — | 54 | 77.9 | — | — | — | — | — | — | — | — | 0.523 | — | — | — | — | — | |
| Multimodal Boostingsource=re-experimented2026.03 | 86.5 | — | 86.5 | — | 54 | 77.9 | — | — | — | — | — | — | — | — | 0.523 | — | — | — | — | — | |
| ComPMissing Rate=0.12025.12 | 86.48 | — | — | — | — | — | — | — | — | — | — | — | 86.6 | — | — | — | — | — | — | — | |
| TRACE2026.06 | 86.45 | — | 86.44 | — | — | 78 | — | — | — | — | — | — | — | — | 0.53 | — | — | — | — | — | |
| MGCLevaluation_protocol=full-modality2026.02 | 86.4 | — | 86.4 | — | 53.9 | 77.2 | — | — | — | — | — | — | — | — | 0.535 | — | — | — | — | — | |
| MIAR2026.01 | 86.23 | — | 86.27 | — | 53.79 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DEVAsource=original paper2026.01 | 86.2 | — | 86.1 | — | 52.3 | 76.9 | — | — | — | — | — | — | — | — | 0.541 | — | — | — | — | — | |
| TMSONsource=original paper2026.01 | 86.2 | — | 86.4 | — | 55.6 | 76.6 | — | — | — | — | — | — | — | — | 0.526 | — | — | — | — | — | |
| HyDiscGANevaluation_protocol=full-modality2026.02 | 86.2 | — | 86.3 | — | 54.4 | 76.1 | — | — | — | — | — | — | — | — | 0.533 | — | — | — | — | — | |
| CLGSIevaluation_protocol=full-modality2026.02 | 86.2 | — | 86.3 | — | 54.6 | 76.3 | — | — | — | — | — | — | — | — | 0.532 | — | — | — | — | — | |
| DEVAVenue=AAAI 2025, Source=Original Paper2026.02 | 86.2 | — | 86.1 | — | 52.3 | 76.9 | — | — | — | — | — | — | — | — | 0.541 | — | — | — | — | — | |
| DEVAsource=original paper2026.03 | 86.2 | — | 86.1 | — | 52.3 | 76.9 | — | — | — | — | — | — | — | — | 0.541 | — | — | — | — | — | |
| DMD2024.12 | 86.1 | — | — | — | — | — | — | — | — | — | — | — | 86 | — | — | — | — | — | — | — | |
| DecAlignaveraged_runs=52025.03 | 86.07 | — | 86.48 | — | 55.02 | 76.8 | — | — | — | — | — | — | — | — | 0.543 | — | — | — | — | — | |
| FuseMoE2026.06 | 86.07 | — | 86.1 | — | — | 78 | — | — | — | — | — | — | — | — | 0.53 | — | — | — | — | — | |
| AOBERT2024.12 | 85.9 | — | — | — | — | — | — | — | — | — | — | — | 86.2 | — | — | — | — | — | — | — | |
| MTMD2024.12 | 85.9 | — | — | — | — | — | — | — | — | — | — | — | 86.1 | — | — | — | — | — | — | — | |
| TSDA2026.05 | 85.9 | — | 86.3 | — | 54.9 | 77.3 | — | — | — | — | — | — | — | — | 0.529 | — | — | — | — | — | |
| GCNetMissing Rate=0.12025.12 | 85.82 | — | — | — | — | — | — | — | — | — | — | — | 85.8 | — | — | — | — | — | — | — | |
| FDMER2024.12 | 85.8 | — | — | — | — | — | — | — | — | — | — | — | 86.1 | — | — | — | — | — | — | — | |
| Confede2024.12 | 85.8 | — | — | — | — | — | — | — | — | — | — | — | 85.8 | — | — | — | — | — | — | — | |
| FDMER2026.01 | 85.8 | — | 86.1 | — | 54.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ConFEDEevaluation_protocol=full-modality2026.02 | 85.8 | — | 85.8 | — | 54.9 | 78 | — | — | — | — | — | — | — | — | 0.522 | — | — | — | — | — | |
| MoMKEMissing Rate=0.12025.12 | 85.65 | — | — | — | — | — | — | — | — | — | — | — | 85.88 | — | — | — | — | — | — | — | |
| SDR-GNNMissing Rate=0.12025.12 | 85.63 | — | — | — | — | — | — | — | — | — | — | — | 85.75 | — | — | — | — | — | — | — | |
| HyCon2024.12 | 85.6 | — | — | — | — | — | — | — | — | — | — | — | 85.4 | — | — | — | — | — | — | — | |
| HyConevaluation_protocol=full-modality2026.02 | 85.6 | — | 85.4 | — | 52.8 | 75.1 | — | — | — | — | — | — | — | — | 0.554 | — | — | — | — | — | |
| UMQMR=0.12026.03 | 85.6 | — | 85.9 | — | 53.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ComPMissing Rate=0.22025.12 | 85.59 | — | — | — | — | — | — | — | — | — | — | — | 85.83 | — | — | — | — | — | — | — | |
| AlignMambaMissing Rate=10%2024.12 | 85.4 | — | — | — | — | — | — | — | — | — | — | — | 85.4 | — | — | — | — | — | — | — | |
| MISA2024.12 | 85.3 | — | — | — | — | — | — | — | — | — | — | — | 85.5 | — | — | — | — | — | — | — | |
| DLFsource=original paper2026.01 | 85.3 | — | 85.4 | — | 53.9 | 76.4 | — | — | — | — | — | — | — | — | 0.536 | — | — | — | — | — | |
| DLFevaluation_protocol=full-modality2026.02 | 85.3 | — | 85.4 | — | 53.9 | 76.4 | — | — | — | — | — | — | — | — | 0.536 | — | — | — | — | — | |
| DLFsource=original paper2026.03 | 85.3 | — | 85.4 | — | 53.9 | 76.4 | — | — | — | — | — | — | — | — | 0.536 | — | — | — | — | — | |
| EMOE2026.05 | 85.3 | — | 85.3 | — | 54.1 | — | — | — | — | — | — | — | — | — | 0.536 | — | — | — | — | — | |
| DLF2026.05 | 85.27 | — | 85.42 | — | 53.9 | 76.4 | — | — | — | — | — | — | — | — | 0.536 | — | — | — | — | — | |
| Self-MMsource=our experiment2026.01 | 85.2 | — | 85.2 | — | 53 | 76.3 | — | — | — | — | — | — | — | — | 0.54 | — | — | — | — | — | |
| Self-MMVenue=AAAI 20212026.02 | 85.2 | — | 85.2 | — | 53 | 76.3 | — | — | — | — | — | — | — | — | 0.54 | — | — | — | — | — | |
| ULGM2024.12 | 85.1 | — | — | — | — | — | — | — | — | — | — | — | 85 | — | — | — | — | — | — | — | |
| IMDer2026.01 | 85.1 | — | 85.1 | — | 53.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DiCMoR2026.01 | 85.1 | — | 85.1 | — | 53.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GCNet2026.01 | 85.1 | — | 85.2 | — | 51.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GCNetMissing Rate=0.22025.12 | 85.1 | — | — | — | — | — | — | — | — | — | — | — | 85.14 | — | — | — | — | — | — | — | |
| ComPMissing Rate=0.32025.12 | 85.1 | — | — | — | — | — | — | — | — | — | — | — | 85.28 | — | — | — | — | — | — | — | |
| SDR-GNNMissing Rate=0.22025.12 | 85.06 | — | — | — | — | — | — | — | — | — | — | — | 85.01 | — | — | — | — | — | — | — | |
| MMIM2024.12 | 85 | — | — | — | — | — | — | — | — | — | — | — | 85.1 | — | — | — | — | — | — | — | |
| EMOEsource=our experiment2026.01 | 85 | — | 85 | — | 52.5 | 76 | — | — | — | — | — | — | — | — | 0.542 | — | — | — | — | — | |
| EMOEVenue=CVPR 20252026.02 | 85 | — | 85 | — | 52.5 | 76 | — | — | — | — | — | — | — | — | 0.542 | — | — | — | — | — | |
| Self-MM2024.12 | 84.9 | — | — | — | — | — | — | — | — | — | — | — | 85 | — | — | — | — | — | — | — | |
| MAG-BERT2024.12 | 84.7 | — | — | — | — | — | — | — | — | — | — | — | 84.8 | — | — | — | — | — | — | — | |
| MoMKEMR=0.12026.03 | 84.7 | — | 85.1 | — | 47.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| IMDerMissing Rate=10%2024.12 | 84.6 | — | — | — | — | — | — | — | — | — | — | — | 84.8 | — | — | — | — | — | — | — | |
| DMDsource=our experiment2026.01 | 84.6 | — | 84.6 | — | 52.8 | 76.8 | — | — | — | — | — | — | — | — | 0.538 | — | — | — | — | — | |
| IMDerMissing Rate=0.12025.12 | 84.6 | — | — | — | — | — | — | — | — | — | — | — | 84.8 | — | — | — | — | — | — | — | |
| MoMKEMissing Rate=0.22025.12 | 84.6 | — | — | — | — | — | — | — | — | — | — | — | 84.76 | — | — | — | — | — | — | — | |
| DMDVenue=CVPR 20232026.02 | 84.6 | — | 84.6 | — | 52.8 | 76.8 | — | — | — | — | — | — | — | — | 0.538 | — | — | — | — | — | |
| GCNetMR=0.12026.03 | 84.5 | — | 84.3 | — | 46.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MAG2026.06 | 84.5 | — | 85.56 | — | — | 79 | — | — | — | — | — | — | — | — | 0.57 | — | — | — | — | — | |
| SDR-GNNMissing Rate=0.32025.12 | 84.37 | — | — | — | — | — | — | — | — | — | — | — | 84.25 | — | — | — | — | — | — | — | |
| GCNetMissing Rate=0.32025.12 | 84.35 | — | — | — | — | — | — | — | — | — | — | — | 84.48 | — | — | — | — | — | — | — | |
| MCIS2026.05 | 84.34 | — | 84.97 | — | 53.85 | 74.7 | — | — | — | — | — | — | — | — | 0.557 | — | — | — | — | — | |
| ICCN2024.12 | 84.2 | — | — | — | — | — | — | — | — | — | — | — | 84.2 | — | — | — | — | — | — | — | |
| CGGM2026.05 | 84.14 | — | 83.9 | — | 53.47 | 76.1 | — | — | — | — | — | — | — | — | 0.551 | — | — | — | — | — | |
| ComPMissing Rate=0.42025.12 | 83.94 | — | — | — | — | — | — | — | — | — | — | — | 84.2 | — | — | — | — | — | — | — | |
| CGGMaveraged_runs=52025.03 | 83.94 | — | 83.72 | — | 52.88 | 76 | — | — | — | — | — | — | — | — | 0.584 | — | — | — | — | — | |
| DMDaveraged_runs=52025.03 | 83.88 | — | 84.17 | — | 54.18 | 75.8 | — | — | — | — | — | — | — | — | 0.561 | — | — | — | — | — | |
| DMD2026.05 | 83.88 | — | 84.17 | — | 54.18 | 75.8 | — | — | — | — | — | — | — | — | 0.561 | — | — | — | — | — | |
| UMQMR=0.22026.03 | 83.8 | — | 84 | — | 51.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DEVA2026.05 | 83.75 | — | 83.17 | — | 52.28 | 76.9 | — | — | — | — | — | — | — | — | 0.541 | — | — | — | — | — | |
| DiCMoRMissing Rate=0.12025.12 | 83.7 | — | — | — | — | — | — | — | — | — | — | — | 83.5 | — | — | — | — | — | — | — | |
| MMINMissing Rate=0.12025.12 | 83.63 | — | — | — | — | — | — | — | — | — | — | — | 83.82 | — | — | — | — | — | — | — | |
| CM-BERT2024.12 | 83.6 | — | — | — | — | — | — | — | — | — | — | — | 83.6 | — | — | — | — | — | — | — | |
| ProMMAAvailable Modalities={a,t}, Missing Rate=30%, Evaluation Threshold=30%2026.04 | 83.55 | — | — | — | — | — | — | — | — | — | — | — | 83.87 | — | — | — | — | — | — | — |