# En-De Chat Translation on BConTrasT (test)

Source: [En-De Chat Translation on BConTrasT (test)](<https://www.sota2.com/research/sota/en-de-chat-translation-on-bcontrast-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:36:51.641Z

Evaluation of English-German Chat Translation performance on the BConTrasT test set, measured by BLEU and TER scores.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | En-De Chat Translation |
| Dataset (including any stated split) | BConTrasT (test) |
| Metric | BLEU |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 16 of 16 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [BLEU](<https://www.sota2.com/research/sota/en-de-chat-translation-on-bcontrast-test.md?metric=BLEU>): Higher is better; unit: PERCENT.

- [TER](<https://www.sota2.com/research/sota/en-de-chat-translation-on-bcontrast-test.md?metric=TER>): Lower is better; unit: PERCENT.

## Recorded results

| Method | BLEU | Result date | Report paper |
| --- | --- | --- | --- |
| SML | 61.16 | Not recorded | 68fa6c861e209131cea347ad |
| SML | 60.65 | Not recorded | 68fa6c861e209131cea347ad |
| CSA-NCT | 60.64 | Not recorded | 68fa6c861e209131cea347ad |
| CPCC | 60.23 | Not recorded | 68fa6c861e209131cea347ad |
| CPCC | 60.13 | Not recorded | 68fa6c861e209131cea347ad |
| CSA-NCT | 59.5 | Not recorded | 68fa6c861e209131cea347ad |
| Trans. | 59.01 | Not recorded | 68fa6c861e209131cea347ad |
| Gate-Trans. | 58.94 | Not recorded | 68fa6c861e209131cea347ad |
| Dia-Trans. | 58.68 | Not recorded | 68fa6c861e209131cea347ad |
| NCT | 58.61 | Not recorded | 68fa6c861e209131cea347ad |
| Gate-Trans. | 58.48 | Not recorded | 68fa6c861e209131cea347ad |
| Trans. | 58.43 | Not recorded | 68fa6c861e209131cea347ad |
| Dia-Trans. | 58.33 | Not recorded | 68fa6c861e209131cea347ad |
| NCT | 58.15 | Not recorded | 68fa6c861e209131cea347ad |
| Trans. w/o FT | 40.53 | Not recorded | 68fa6c861e209131cea347ad |
| Trans. w/o FT | 40.02 | Not recorded | 68fa6c861e209131cea347ad |

### SML

BLEU: 61.16. Result ID: 698f1fed3a6c314849f6018c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c861e209131cea347ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c861e209131cea347ad.md>)

[Implementation](<https://github.com/XL2248/SML>)

Recorded evaluation configuration: {"Model Size":"Big"}. This record does not assert independent reproduction.

### SML

BLEU: 60.65. Result ID: 698f1fed3a6c314849f60184.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c861e209131cea347ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c861e209131cea347ad.md>)

[Implementation](<https://github.com/XL2248/SML>)

Recorded evaluation configuration: {"Model Size":"Base"}. This record does not assert independent reproduction.

### CSA-NCT

BLEU: 60.64. Result ID: 698f1fed3a6c314849f6018b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c861e209131cea347ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6aa61e209131cea29715.md>)

Recorded evaluation configuration: {"Model Size":"Big"}. This record does not assert independent reproduction.

### CPCC

BLEU: 60.23. Result ID: 698f1fed3a6c314849f6018a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c861e209131cea347ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a741e209131cea283ce.md>)

Recorded evaluation configuration: {"Model Size":"Big"}. This record does not assert independent reproduction.

### CPCC

BLEU: 60.13. Result ID: 698f1fed3a6c314849f60182.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c861e209131cea347ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a741e209131cea283ce.md>)

Recorded evaluation configuration: {"Model Size":"Base"}. This record does not assert independent reproduction.

### CSA-NCT

BLEU: 59.5. Result ID: 698f1fed3a6c314849f60183.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c861e209131cea347ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6aa61e209131cea29715.md>)

Recorded evaluation configuration: {"Model Size":"Base"}. This record does not assert independent reproduction.

### Trans.

BLEU: 59.01. Result ID: 698f1fed3a6c314849f60186.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c861e209131cea347ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa703d1e209131cea49db1.md>)

[Implementation](<https://github.com/tensorflow/tensor2tensor>)

Recorded evaluation configuration: {"Model Size":"Big","Fine-tuned":"true"}. This record does not assert independent reproduction.

### Gate-Trans.

BLEU: 58.94. Result ID: 698f1fed3a6c314849f60188.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c861e209131cea347ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64e21e209131cea070a5.md>)

Recorded evaluation configuration: {"Model Size":"Big"}. This record does not assert independent reproduction.

### Dia-Trans.

BLEU: 58.68. Result ID: 698f1fed3a6c314849f60187.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c861e209131cea347ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64c71e209131cea068cb.md>)

Recorded evaluation configuration: {"Model Size":"Big"}. This record does not assert independent reproduction.

### NCT

BLEU: 58.61. Result ID: 698f1fed3a6c314849f60189.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c861e209131cea347ad.md>)

Recorded evaluation configuration: {"Model Size":"Big"}. This record does not assert independent reproduction.

### Gate-Trans.

BLEU: 58.48. Result ID: 698f1fed3a6c314849f60180.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c861e209131cea347ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64e21e209131cea070a5.md>)

Recorded evaluation configuration: {"Model Size":"Base"}. This record does not assert independent reproduction.

### Trans.

BLEU: 58.43. Result ID: 698f1fed3a6c314849f6017e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c861e209131cea347ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa703d1e209131cea49db1.md>)

[Implementation](<https://github.com/tensorflow/tensor2tensor>)

Recorded evaluation configuration: {"Model Size":"Base","Fine-tuned":"true"}. This record does not assert independent reproduction.

### Dia-Trans.

BLEU: 58.33. Result ID: 698f1fed3a6c314849f6017f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c861e209131cea347ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64c71e209131cea068cb.md>)

Recorded evaluation configuration: {"Model Size":"Base"}. This record does not assert independent reproduction.

### NCT

BLEU: 58.15. Result ID: 698f1fed3a6c314849f60181.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c861e209131cea347ad.md>)

Recorded evaluation configuration: {"Model Size":"Base"}. This record does not assert independent reproduction.

### Trans. w/o FT

BLEU: 40.53. Result ID: 698f1fed3a6c314849f60185.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c861e209131cea347ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa703d1e209131cea49db1.md>)

[Implementation](<https://github.com/tensorflow/tensor2tensor>)

Recorded evaluation configuration: {"Model Size":"Big","Fine-tuned":"false"}. This record does not assert independent reproduction.

### Trans. w/o FT

BLEU: 40.02. Result ID: 698f1fed3a6c314849f6017d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c861e209131cea347ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa703d1e209131cea49db1.md>)

[Implementation](<https://github.com/tensorflow/tensor2tensor>)

Recorded evaluation configuration: {"Model Size":"Base","Fine-tuned":"false"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
