Attribute-controlled Machine Translation on COCOA-MT (aggregated)
41.9BLEUBLOOM 175B RAMP
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| BLOOM 175B RAMPBackbone=BLOOM 175B, Prompting Setting=Same-Language, Variant=RAMP, In-context Examples=162023.05 | 41.9 | 0.711 | 97.3 | 97 | |
| BLOOM 175B +markBackbone=BLOOM 175B, Prompting Setting=Same-Language, Variant=attribute marking (+mark), In-context Examples=162023.05 | 40.3 | 0.688 | 97 | 97 | |
| BLOOM 175B baseBackbone=BLOOM 175B, Prompting Setting=Same-Language, Variant=base, In-context Examples=162023.05 | 39.9 | 0.691 | 93 | 94 | |
| Adapted MTPrompting Setting=Same-Language2023.05 | 38.5 | 0.454 | 69.1 | 69.3 | |
| BLOOM 175B base (Cross-Lingual)Backbone=BLOOM 175B, Prompting Setting=Cross-Lingual, Variant=base, In-context Examples=162023.05 | 32.1 | 0.644 | 56.7 | 59.6 | |
| BLOOM 175B RAMP (Cross-Lingual)Backbone=BLOOM 175B, Prompting Setting=Cross-Lingual, Variant=RAMP, In-context Examples=162023.05 | 31.8 | 0.646 | 62.5 | 62.2 | |
| XGLM 7.5B RAMPBackbone=XGLM 7.5B, Prompting Setting=Same-Language, Variant=RAMP, In-context Examples=162023.05 | 30 | 0.451 | 93.8 | 92.3 | |
| XGLM 7.5B +markBackbone=XGLM 7.5B, Prompting Setting=Same-Language, Variant=attribute marking (+mark), In-context Examples=162023.05 | 28.7 | 0.423 | 92 | 90.2 | |
| XGLM 7.5B baseBackbone=XGLM 7.5B, Prompting Setting=Same-Language, Variant=base, In-context Examples=162023.05 | 28.6 | 0.463 | 83.5 | 84.6 |