# Formality Style Transfer on GYAFC Family & Relationships (test)

Source: [Formality Style Transfer on GYAFC Family & Relationships (test)](<https://www.sota2.com/research/sota/formality-style-transfer-on-gyafc-family-and-relationships-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:36:51.112Z

Evaluation of Formality Style Transfer performance on the test split of the GYAFC Family & Relationships dataset, reporting BLEU, Accuracy, and HM scores.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Formality Style Transfer |
| Dataset (including any stated split) | GYAFC Family & Relationships (test) |
| Metric | BLEU |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [BLEU](<https://www.sota2.com/research/sota/formality-style-transfer-on-gyafc-family-and-relationships-test.md?metric=BLEU>): Higher is better; unit: PERCENT.

- [Accuracy](<https://www.sota2.com/research/sota/formality-style-transfer-on-gyafc-family-and-relationships-test.md?metric=Accuracy>): Higher is better; unit: PERCENT.

- [HM Score](<https://www.sota2.com/research/sota/formality-style-transfer-on-gyafc-family-and-relationships-test.md?metric=HM%20Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | BLEU | Result date | Report paper |
| --- | --- | --- | --- |
| Ours (best) | 81.37 | Not recorded | 68fa6c191e209131cea32291 |
| Ours (base) | 80.32 | Not recorded | 68fa6c191e209131cea32291 |
| Chawla's | 79.92 | Not recorded | 68fa6c191e209131cea32291 |
| BART-large+SC+BLEU | 79.25 | Not recorded | 68fa6c191e209131cea32291 |
| CARI | 78.05 | Not recorded | 68fa6c191e209131cea32291 |
| Transformers (DA) | 77.97 | Not recorded | 68fa6c191e209131cea32291 |
| GPT-CAT | 77.26 | Not recorded | 68fa6c191e209131cea32291 |
| NMT-Multi-task | 75.35 | Not recorded | 68fa6c191e209131cea32291 |
| Hybrid Annotations | 74.36 | Not recorded | 68fa6c191e209131cea32291 |
| NMT | 74.22 | Not recorded | 68fa6c191e209131cea32291 |

### Ours (best)

BLEU: 81.37. Result ID: 698ed2baffc3901de0a1ba7e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

[Implementation](<https://github.com/Aolius/semi-fst>)

Recorded evaluation configuration: {"unlabeled\_data":true}. This record does not assert independent reproduction.

### Ours (base)

BLEU: 80.32. Result ID: 698ed2baffc3901de0a1ba7d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

[Implementation](<https://github.com/Aolius/semi-fst>)

Recorded evaluation configuration: {"unlabeled\_data":false}. This record does not assert independent reproduction.

### Chawla's

BLEU: 79.92. Result ID: 698ed2baffc3901de0a1ba7b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68851e209131cea1caa6.md>)

Recorded evaluation configuration: {"unlabeled\_data":true}. This record does not assert independent reproduction.

### BART-large+SC+BLEU

BLEU: 79.25. Result ID: 698ed2baffc3901de0a1ba7c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a571e209131cea27925.md>)

[Implementation](<https://github.com/laihuiyuan/Pre-trained-formality-transfer>)

Recorded evaluation configuration: {"unlabeled\_data":false}. This record does not assert independent reproduction.

### CARI

BLEU: 78.05. Result ID: 698ed2baffc3901de0a1ba7a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a0f1e209131cea25e02.md>)

[Implementation](<https://github.com/raosudha89/GYAFC-corpus>)

Recorded evaluation configuration: {"unlabeled\_data":false}. This record does not assert independent reproduction.

### Transformers (DA)

BLEU: 77.97. Result ID: 698ed2baffc3901de0a1ba79.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67891e209131cea16bc7.md>)

Recorded evaluation configuration: {"unlabeled\_data":true}. This record does not assert independent reproduction.

### GPT-CAT

BLEU: 77.26. Result ID: 698ed2baffc3901de0a1ba78.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

Recorded evaluation configuration: {"unlabeled\_data":false}. This record does not assert independent reproduction.

### NMT-Multi-task

BLEU: 75.35. Result ID: 698ed2baffc3901de0a1ba77.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64811e209131cea04f0b.md>)

Recorded evaluation configuration: {"unlabeled\_data":false}. This record does not assert independent reproduction.

### Hybrid Annotations

BLEU: 74.36. Result ID: 698ed2baffc3901de0a1ba76.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65861e209131cea0ad38.md>)

Recorded evaluation configuration: {"unlabeled\_data":true}. This record does not assert independent reproduction.

### NMT

BLEU: 74.22. Result ID: 698ed2baffc3901de0a1ba75.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64491e209131cea03b73.md>)

Recorded evaluation configuration: {"unlabeled\_data":false}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
