MMT
Benchmarks
TaskDatasetSOTA resultTrendResults
MMT
3.85Speedup Ratio
60
MMT emo
60.8Accuracy
20
MMT
77.2Accuracy
19
MMT-47 Action Understanding
53.48Accuracy
17
MMT-47 High Level Reasoning
45.92Accuracy
17
MMT-47 Commonsense Reasoning
84.98Accuracy
17
MMT-47
94.74Accuracy
17
MMT (val)
67.4Accuracy
14
MMT eng-xx very-low-resource
49.2chrF++
12
MMT eng-xx high-resource
64.7chrF++
12
MMT eng-xx (all)
55.1chrF++
12
MMT (val)
67.4Accuracy
11
MMT
1,075.5Score
8
MMT xx-yy (all)
42.8chrF++
6
MMT xx-eng low-resource
51.5chrF++
6
MMT eng-xx low-resource
41.8chrF++
6