# Formality Style Transfer on GYAFC Entertainment & Music (test)

Source: [Formality Style Transfer on GYAFC Entertainment & Music (test)](<https://www.sota2.com/research/sota/formality-style-transfer-on-gyafc-entertainment-and-music-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:36:51.096Z

Evaluation of models performing Formality Style Transfer on the test split of the GYAFC Entertainment & Music dataset, measured using BLEU, Accuracy, and HM scores.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Formality Style Transfer |
| Dataset (including any stated split) | GYAFC Entertainment & Music (test) |
| Metric | BLEU |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [BLEU](<https://www.sota2.com/research/sota/formality-style-transfer-on-gyafc-entertainment-and-music-test.md?metric=BLEU>): Higher is better; unit: SCALAR.

- [Accuracy](<https://www.sota2.com/research/sota/formality-style-transfer-on-gyafc-entertainment-and-music-test.md?metric=Accuracy>): Higher is better; unit: PERCENT.

- [HM Score](<https://www.sota2.com/research/sota/formality-style-transfer-on-gyafc-entertainment-and-music-test.md?metric=HM%20Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | BLEU | Result date | Report paper |
| --- | --- | --- | --- |
| Ours (best) | 78.75 | Not recorded | 68fa6c191e209131cea32291 |
| Ours (base) | 76.87 | Not recorded | 68fa6c191e209131cea32291 |
| BART-large+SC+BLEU | 76.5 | Not recorded | 68fa6c191e209131cea32291 |
| Chawla's | 76.17 | Not recorded | 68fa6c191e209131cea32291 |
| CARI | 74.31 | Not recorded | 68fa6c191e209131cea32291 |
| Transformers (DA) | 74.24 | Not recorded | 68fa6c191e209131cea32291 |
| NMT-Multi-task | 72.01 | Not recorded | 68fa6c191e209131cea32291 |
| GPT-CAT | 71.39 | Not recorded | 68fa6c191e209131cea32291 |
| Hybrid Annotations | 69.28 | Not recorded | 68fa6c191e209131cea32291 |
| NMT | 68.41 | Not recorded | 68fa6c191e209131cea32291 |

### Ours (best)

BLEU: 78.75. Result ID: 698ed2baffc3901de0a1ba74.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

[Implementation](<https://github.com/Aolius/semi-fst>)

Recorded evaluation configuration: {"unlabeled\_data":true}. This record does not assert independent reproduction.

### Ours (base)

BLEU: 76.87. Result ID: 698ed2baffc3901de0a1ba73.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

[Implementation](<https://github.com/Aolius/semi-fst>)

Recorded evaluation configuration: {"unlabeled\_data":false}. This record does not assert independent reproduction.

### BART-large+SC+BLEU

BLEU: 76.5. Result ID: 698ed2baffc3901de0a1ba72.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a571e209131cea27925.md>)

[Implementation](<https://github.com/laihuiyuan/Pre-trained-formality-transfer>)

Recorded evaluation configuration: {"unlabeled\_data":false}. This record does not assert independent reproduction.

### Chawla's

BLEU: 76.17. Result ID: 698ed2baffc3901de0a1ba71.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68851e209131cea1caa6.md>)

Recorded evaluation configuration: {"unlabeled\_data":true}. This record does not assert independent reproduction.

### CARI

BLEU: 74.31. Result ID: 698ed2baffc3901de0a1ba70.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a0f1e209131cea25e02.md>)

[Implementation](<https://github.com/raosudha89/GYAFC-corpus>)

Recorded evaluation configuration: {"unlabeled\_data":false}. This record does not assert independent reproduction.

### Transformers (DA)

BLEU: 74.24. Result ID: 698ed2baffc3901de0a1ba6f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67891e209131cea16bc7.md>)

Recorded evaluation configuration: {"unlabeled\_data":true}. This record does not assert independent reproduction.

### NMT-Multi-task

BLEU: 72.01. Result ID: 698ed2baffc3901de0a1ba6d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64811e209131cea04f0b.md>)

Recorded evaluation configuration: {"unlabeled\_data":false}. This record does not assert independent reproduction.

### GPT-CAT

BLEU: 71.39. Result ID: 698ed2baffc3901de0a1ba6e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

Recorded evaluation configuration: {"unlabeled\_data":false}. This record does not assert independent reproduction.

### Hybrid Annotations

BLEU: 69.28. Result ID: 698ed2baffc3901de0a1ba6c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65861e209131cea0ad38.md>)

Recorded evaluation configuration: {"unlabeled\_data":true}. This record does not assert independent reproduction.

### NMT

BLEU: 68.41. Result ID: 698ed2baffc3901de0a1ba6b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64491e209131cea03b73.md>)

Recorded evaluation configuration: {"unlabeled\_data":false}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
