Machine Translation on WMT Romanian-English 2016
43.8BLEUPaLM 540B
Evaluation Results
| Method | Links | |
|---|---|---|
| PaLM 540Bshots=52022.04 | 43.8 | |
| PaLM 540Bshots=12022.04 | 42.1 | |
| PaLM 540Bshots=02022.04 | 39.9 | |
| Finetuned SOTAprotocol=Supervised2022.04 | 39.1 | |
| GPT-3 175Bshots=12022.04 | 38.6 | |
| FLANshots=92022.04 | 37.3 | |
| FLANshots=02022.04 | 36.8 | |
| SpecDecdraft size (k)=252025.08 | 35.03 | |
| CM-ASDdynamic drafting=true2025.08 | 34.94 | |
| SpecDecdraft size (k)=102025.08 | 34.88 | |
| Transformer-basebeam size (b)=52025.08 | 34.86 | |
| Transformer-basebeam size (b)=12025.08 | 34.65 | |
| Blockwisedraft size (k)=102025.08 | 34.65 | |
| Blockwisedraft size (k)=252025.08 | 34.65 |