En-De Chat Translation on BConTrasT (test)
61.16BLEUSML
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SMLModel Size=Big2022.05 | 61.16 | 25 | |
| SMLModel Size=Base2022.05 | 60.65 | 25.3 | |
| CSA-NCTModel Size=Big2022.05 | 60.64 | 25.3 | |
| CPCCModel Size=Big2022.05 | 60.23 | 25.6 | |
| CPCCModel Size=Base2022.05 | 60.13 | 25.4 | |
| CSA-NCTModel Size=Base2022.05 | 59.5 | 25.7 | |
| Trans.Model Size=Big, Fine-tuned=true2022.05 | 59.01 | 26 | |
| Gate-Trans.Model Size=Big2022.05 | 58.94 | 26.2 | |
| Dia-Trans.Model Size=Big2022.05 | 58.68 | 26.8 | |
| NCTModel Size=Big2022.05 | 58.61 | 26.5 | |
| Gate-Trans.Model Size=Base2022.05 | 58.48 | 26.6 | |
| Trans.Model Size=Base, Fine-tuned=true2022.05 | 58.43 | 26.7 | |
| Dia-Trans.Model Size=Base2022.05 | 58.33 | 26.8 | |
| NCTModel Size=Base2022.05 | 58.15 | 27.1 | |
| Trans. w/o FTModel Size=Big, Fine-tuned=false2022.05 | 40.53 | 42.2 | |
| Trans. w/o FTModel Size=Base, Fine-tuned=false2022.05 | 40.02 | 42.5 |