# Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfer

Source: [Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfer](<https://www.sota2.com/research/paper/68fa64491e209131cea03b73>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T21:00:11.434Z

Authors: Sudha Rao, Joel Tetreault

Published: 2018-03-17T16:35:04.000Z

## Abstract

Style transfer is the task of automatically transforming a piece of text in one particular style into another. A major barrier to progress in this field has been a lack of training and evaluation datasets, as well as benchmarks and automatic metrics. In this work, we create the largest corpus for a particular stylistic transfer (formality) and show that techniques from the machine translation community can serve as strong baselines for future work. We also discuss challenges of using automatic metrics.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Formality Style Transfer on GYAFC E&M (test)](<https://www.sota2.com/research/sota/formality-style-transfer-on-gyafc-e-and-m-test.md>): Formality Style Transfer; GYAFC E&M (test); BLEU: 72.01.

- [Formality Style Transfer on GYAFC F&R (test)](<https://www.sota2.com/research/sota/formality-style-transfer-on-gyafc-f-and-r-test.md>): Formality Style Transfer; GYAFC F&R (test); BLEU: 75.67.

- [Formality Style Transfer on GYAFC Entertainment & Music (test)](<https://www.sota2.com/research/sota/formality-style-transfer-on-gyafc-entertainment-and-music-test.md>): Formality Style Transfer; GYAFC Entertainment & Music (test); BLEU: 68.41.

- [Formality Style Transfer on GYAFC Family & Relationships (test)](<https://www.sota2.com/research/sota/formality-style-transfer-on-gyafc-family-and-relationships-test.md>): Formality Style Transfer; GYAFC Family & Relationships (test); BLEU: 74.22.

- [Formality Style Transfer on GYAFC Entertainment & Music 1.0 (test)](<https://www.sota2.com/research/sota/formality-style-transfer-on-gyafc-entertainment-and-music-1-0-test.md>): Formality Style Transfer; GYAFC Entertainment & Music 1.0 (test); BLEURT: -0.1.

- [Formality Style Transfer on GYAFC Family & Relationships 1.0 (test)](<https://www.sota2.com/research/sota/formality-style-transfer-on-gyafc-family-and-relationships-1-0-test.md>): Formality Style Transfer; GYAFC Family & Relationships 1.0 (test); BLEU: 0.477.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1803.06535>)

[PDF](<https://arxiv.org/pdf/1803.06535.pdf>)
