CMU-MOSEI
Benchmarks
TaskDatasetSOTA resultTrendResults
CMU-MOSEI (test)
91.7F1 Score
406
CMU-MOSEI (test)
87.26F1 Score
96
CMU-MOSEI standard (test)
85.86Accuracy
65
CMU-MOSEI
0.777WF1
60
CMU-MOSEI (test)
54.5ACC7
56
CMU-MOSEI
0.528MAE
31
CMU-MOSEI (0.3, 0.5, 0.7) (test)
84.76Accuracy
24
CMU-MOSEI segments (test)
86.4ACC2
22
CMU-MOSEI Word Aligned (test)
51.8Accuracy (7-Class)
22
CMU-MOSEI
84F1 Score
19
CMU-MOSEI (test)
54.6Accuracy (7)
19
CMU-MOSEI Unaligned (test)
82.4Accuracy (2-Class)
18
CMU-MOSEI BERT-based (test)
85.7Accuracy (2-Class)
14
CMU-MOSEI
81.12ACC
13
CMU-MOSEI β = 30% (test)
38.57Overall Accuracy
13
CMU-MOSEI β = 10% (test)
36.13Overall Accuracy
13
CMU-MOSEI (0.7, 0.5, 0.3) (test)
82.53Accuracy
12
CMU-MOSEI (0.7, 0.3, 0.5) (test)
84.84Accuracy
12
CMU-MOSEI (0.5, 0.7, 0.3) (test)
79.83Accuracy
12
CMU-MOSEI (0.3, 0.7, 0.5) (test)
78.81Accuracy
12
CMU-MOSEI
56.37-Class Accuracy
10
CMU-MOSEI unaligned
32.02Accuracy (2-class)
10
CMU-MOSEI OOD (test)
49.3Accuracy (7-class)
8
CMU-MOSEI Unaligned
49.7Accuracy (7-class)
7
CMU-MOSEI
31F1 (7-class)
7