List your company
ResearchFormerly WizWand

Machine Translation Evaluation on WMT segment-level 2019 (test)

44.5Pearson RBERTScore
37.2239.114142.89Oct 16, 2021
Updated 8mo ago

Evaluation results

MethodLinks
BERTScoreBackbone=DeBERTa-XLarge, Params=900M, Runtime=3m 49s2021.1044.5
MoverScoreBackbone=BERT-Base, Params=110M, Runtime=64m 32s2021.1044
FrugalScoreBackbone=BERT-Medium, Teacher=MoverScore (BERT-Base), Params=41.7M, Runtime=1m 55s2021.1043.6
BERTScoreBackbone=RoBERTa-Large, Params=355M, Runtime=3m 03s2021.1043.2
FrugalScoreBackbone=BERT-Medium, Teacher=BERTScore (DeBERTa-XLarge), Params=41.7M, Runtime=1m 55s2021.1043
FrugalScoreBackbone=BERT-Small, Teacher=MoverScore (BERT-Base), Params=29.1M, Runtime=1m 35s2021.1042.8
BERTScoreBackbone=BERT-Base, Params=110M, Runtime=2m 09s2021.1041.9
FrugalScoreBackbone=BERT-Medium, Teacher=BERTScore (BERT-Base), Params=41.7M, Runtime=1m 55s2021.1041.9
FrugalScoreBackbone=BERT-Medium, Teacher=BERTScore (RoBERTa-Large), Params=41.7M, Runtime=1m 55s2021.1041.7
FrugalScoreBackbone=BERT-Small, Teacher=BERTScore (DeBERTa-XLarge), Params=29.1M, Runtime=1m 35s2021.1041.5
FrugalScoreBackbone=BERT-Small, Teacher=BERTScore (BERT-Base), Params=29.1M, Runtime=1m 35s2021.1041.3
FrugalScoreBackbone=BERT-Small, Teacher=BERTScore (RoBERTa-Large), Params=29.1M, Runtime=1m 35s2021.1040.5
BERTScoreBackbone=BERT-Medium, Params=41.7M, Runtime=2m 04s2021.1039.8
FrugalScoreBackbone=BERT-Tiny, Teacher=MoverScore (BERT-Base), Params=4.4M, Runtime=1m 18s2021.1039.8
BERTScoreBackbone=BERT-Small, Params=29.1M, Runtime=1m 42s2021.1039.1
FrugalScoreBackbone=BERT-Tiny, Teacher=BERTScore (BERT-Base), Params=4.4M, Runtime=1m 18s2021.1038.4
FrugalScoreBackbone=BERT-Tiny, Teacher=BERTScore (DeBERTa-XLarge), Params=4.4M, Runtime=1m 18s2021.1038
BERTScoreBackbone=BERT-Tiny, Params=4.4M, Runtime=1m 22s2021.1037.6
FrugalScoreBackbone=BERT-Tiny, Teacher=BERTScore (RoBERTa-Large), Params=4.4M, Runtime=1m 18s2021.1037.5