Machine Translation Evaluation on WMT segment-level 2019 (test)
44.5Pearson RBERTScore
Evaluation Results
| Method | Links | |
|---|---|---|
| BERTScoreBackbone=DeBERTa-XLarge, Params=900M, Runtime=3m 49s2021.10 | 44.5 | |
| MoverScoreBackbone=BERT-Base, Params=110M, Runtime=64m 32s2021.10 | 44 | |
| FrugalScoreBackbone=BERT-Medium, Teacher=MoverScore (BERT-Base), Params=41.7M, Runtime=1m 55s2021.10 | 43.6 | |
| BERTScoreBackbone=RoBERTa-Large, Params=355M, Runtime=3m 03s2021.10 | 43.2 | |
| FrugalScoreBackbone=BERT-Medium, Teacher=BERTScore (DeBERTa-XLarge), Params=41.7M, Runtime=1m 55s2021.10 | 43 | |
| FrugalScoreBackbone=BERT-Small, Teacher=MoverScore (BERT-Base), Params=29.1M, Runtime=1m 35s2021.10 | 42.8 | |
| BERTScoreBackbone=BERT-Base, Params=110M, Runtime=2m 09s2021.10 | 41.9 | |
| FrugalScoreBackbone=BERT-Medium, Teacher=BERTScore (BERT-Base), Params=41.7M, Runtime=1m 55s2021.10 | 41.9 | |
| FrugalScoreBackbone=BERT-Medium, Teacher=BERTScore (RoBERTa-Large), Params=41.7M, Runtime=1m 55s2021.10 | 41.7 | |
| FrugalScoreBackbone=BERT-Small, Teacher=BERTScore (DeBERTa-XLarge), Params=29.1M, Runtime=1m 35s2021.10 | 41.5 | |
| FrugalScoreBackbone=BERT-Small, Teacher=BERTScore (BERT-Base), Params=29.1M, Runtime=1m 35s2021.10 | 41.3 | |
| FrugalScoreBackbone=BERT-Small, Teacher=BERTScore (RoBERTa-Large), Params=29.1M, Runtime=1m 35s2021.10 | 40.5 | |
| BERTScoreBackbone=BERT-Medium, Params=41.7M, Runtime=2m 04s2021.10 | 39.8 | |
| FrugalScoreBackbone=BERT-Tiny, Teacher=MoverScore (BERT-Base), Params=4.4M, Runtime=1m 18s2021.10 | 39.8 | |
| BERTScoreBackbone=BERT-Small, Params=29.1M, Runtime=1m 42s2021.10 | 39.1 | |
| FrugalScoreBackbone=BERT-Tiny, Teacher=BERTScore (BERT-Base), Params=4.4M, Runtime=1m 18s2021.10 | 38.4 | |
| FrugalScoreBackbone=BERT-Tiny, Teacher=BERTScore (DeBERTa-XLarge), Params=4.4M, Runtime=1m 18s2021.10 | 38 | |
| BERTScoreBackbone=BERT-Tiny, Params=4.4M, Runtime=1m 22s2021.10 | 37.6 | |
| FrugalScoreBackbone=BERT-Tiny, Teacher=BERTScore (RoBERTa-Large), Params=4.4M, Runtime=1m 18s2021.10 | 37.5 |