# Machine Translation on WMT Romanian-English 2016

Source: [Machine Translation on WMT Romanian-English 2016](<https://www.sota2.com/research/sota/machine-translation-on-wmt-romanian-english-2016>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-29T07:32:55.556Z

Evaluation of Machine Translation performance on the WMT 2016 Romanian-English dataset, measured using the BLEU score.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Machine Translation |
| Dataset (including any stated split) | WMT Romanian-English 2016 |
| Metric | BLEU |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [BLEU](<https://www.sota2.com/research/sota/machine-translation-on-wmt-romanian-english-2016.md?metric=BLEU>): Higher is better; unit: PERCENT.

## Recorded results

| Method | BLEU | Result date | Report paper |
| --- | --- | --- | --- |
| PaLM 540B | 43.8 | Not recorded | 68fa6d931e209131cea3abf2 |
| PaLM 540B | 42.1 | Not recorded | 68fa6d931e209131cea3abf2 |
| PaLM 540B | 39.9 | Not recorded | 68fa6d931e209131cea3abf2 |
| Finetuned SOTA | 39.1 | Not recorded | 68fa6d931e209131cea3abf2 |
| GPT-3 175B | 38.6 | Not recorded | 68fa6d931e209131cea3abf2 |
| FLAN | 37.3 | Not recorded | 68fa6d931e209131cea3abf2 |
| FLAN | 36.8 | Not recorded | 68fa6d931e209131cea3abf2 |
| SpecDec | 35.03 | Not recorded | 68fa7acf1e209131cea853fb |
| CM-ASD | 34.94 | Not recorded | 68fa7acf1e209131cea853fb |
| SpecDec | 34.88 | Not recorded | 68fa7acf1e209131cea853fb |
| Transformer-base | 34.86 | Not recorded | 68fa7acf1e209131cea853fb |
| Transformer-base | 34.65 | Not recorded | 68fa7acf1e209131cea853fb |
| Blockwise | 34.65 | Not recorded | 68fa7acf1e209131cea853fb |
| Blockwise | 34.65 | Not recorded | 68fa7acf1e209131cea853fb |

### PaLM 540B

BLEU: 43.8. Result ID: 69a1481c35dfcabb00e5fcb6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d931e209131cea3abf2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d931e209131cea3abf2.md>)

Recorded evaluation configuration: {"shots":"5"}. This record does not assert independent reproduction.

### PaLM 540B

BLEU: 42.1. Result ID: 69a1481c35dfcabb00e5fcb4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d931e209131cea3abf2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d931e209131cea3abf2.md>)

Recorded evaluation configuration: {"shots":"1"}. This record does not assert independent reproduction.

### PaLM 540B

BLEU: 39.9. Result ID: 69a1481c35dfcabb00e5fcb2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d931e209131cea3abf2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d931e209131cea3abf2.md>)

Recorded evaluation configuration: {"shots":"0"}. This record does not assert independent reproduction.

### Finetuned SOTA

BLEU: 39.1. Result ID: 69a1481c35dfcabb00e5fcb7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d931e209131cea3abf2.md>)

Recorded evaluation configuration: {"protocol":"Supervised"}. This record does not assert independent reproduction.

### GPT-3 175B

BLEU: 38.6. Result ID: 69a1481c35dfcabb00e5fcb3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d931e209131cea3abf2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa680c1e209131cea19d53.md>)

[Implementation](<https://github.com/openai/gpt-3/blob/master/overlap_frequency.md>)

Recorded evaluation configuration: {"shots":"1"}. This record does not assert independent reproduction.

### FLAN

BLEU: 37.3. Result ID: 69a1481c35dfcabb00e5fcb5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d931e209131cea3abf2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bc51e209131cea30383.md>)

[Implementation](<https://github.com/google-research/flan>)

Recorded evaluation configuration: {"shots":"9"}. This record does not assert independent reproduction.

### FLAN

BLEU: 36.8. Result ID: 69a1481c35dfcabb00e5fcb1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d931e209131cea3abf2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bc51e209131cea30383.md>)

[Implementation](<https://github.com/google-research/flan>)

Recorded evaluation configuration: {"shots":"0"}. This record does not assert independent reproduction.

### SpecDec

BLEU: 35.03. Result ID: 6a19411efbc373592c134334.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7acf1e209131cea853fb.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e765.md>)

Recorded evaluation configuration: {"draft size (k)":"25"}. This record does not assert independent reproduction.

### CM-ASD

BLEU: 34.94. Result ID: 6a19411efbc373592c134335.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7acf1e209131cea853fb.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7acf1e209131cea853fb.md>)

Recorded evaluation configuration: {"dynamic drafting":"true"}. This record does not assert independent reproduction.

### SpecDec

BLEU: 34.88. Result ID: 6a19411efbc373592c134333.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7acf1e209131cea853fb.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e765.md>)

Recorded evaluation configuration: {"draft size (k)":"10"}. This record does not assert independent reproduction.

### Transformer-base

BLEU: 34.86. Result ID: 6a19411efbc373592c13432f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7acf1e209131cea853fb.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa622a1e209131ce9f7cd4.md>)

[Implementation](<http://www.github.com/deepmind/rc-data/>)

Recorded evaluation configuration: {"beam size (b)":"5"}. This record does not assert independent reproduction.

### Transformer-base

BLEU: 34.65. Result ID: 6a19411efbc373592c134330.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7acf1e209131cea853fb.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa622a1e209131ce9f7cd4.md>)

[Implementation](<http://www.github.com/deepmind/rc-data/>)

Recorded evaluation configuration: {"beam size (b)":"1"}. This record does not assert independent reproduction.

### Blockwise

BLEU: 34.65. Result ID: 6a19411efbc373592c134331.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7acf1e209131cea853fb.md>)

Recorded evaluation configuration: {"draft size (k)":"10"}. This record does not assert independent reproduction.

### Blockwise

BLEU: 34.65. Result ID: 6a19411efbc373592c134332.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7acf1e209131cea853fb.md>)

Recorded evaluation configuration: {"draft size (k)":"25"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
