MCIF
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MCIF long track
83.75COMET Score
20
MCIF long track
5.88WER
20
MCIF long track
29.74BERTScore
20
MCIF long track
40.86BERTScore
20
MCIF short-form
45.13BERTScore (SQA)
10
MCIF en-it
38.14BLEU
9
MCIF en-de
30.88BLEU
9
MCIF (test)
86.59XCOMET-XL
9
MCIF short-form
78.69ST COMET
8
MCIF En-It (dev)
43.56BLEU
7
MCIF En-De (dev)
31.73BLEU
7
MCIF constrained short audio
34.6BERTScore-F1 (EN)
4
MCIF constrained, short audio
21.49WER
4
MCIF short-form
88.77ASR Accuracy
4
MCIF short-form
2.071SIFS Score
2