# Semi-Supervised Formality Style Transfer with Consistency Training

Source: [Semi-Supervised Formality Style Transfer with Consistency Training](<https://www.sota2.com/research/paper/68fa6c191e209131cea32291>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-01-01T14:15:03.332Z

Authors: Ao Liu, An Wang, Naoaki Okazaki

Published: 2022-03-25T12:40:36.000Z

## Abstract

Formality style transfer (FST) is a task that involves paraphrasing an informal sentence into a formal one without altering its meaning. To address the data-scarcity problem of existing parallel datasets, previous studies tend to adopt a cycle-reconstruction scheme to utilize additional unlabeled data, where the FST model mainly benefits from target-side unlabeled sentences. In this work, we propose a simple yet effective semi-supervised framework to better utilize source-side unlabeled sentences based on consistency training. Specifically, our approach augments pseudo-parallel data obtained from a source-side informal sentence by enforcing the model to generate similar outputs for its perturbed version. Moreover, we empirically examined the effects of various data perturbation methods and propose effective data filtering strategies to improve our framework. Experimental results on the GYAFC benchmark demonstrate that our approach can achieve state-of-the-art results, even with less than 40% of the parallel data.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Formality Style Transfer on GYAFC Entertainment & Music (test)](<https://www.sota2.com/research/sota/formality-style-transfer-on-gyafc-entertainment-and-music-test.md>): Formality Style Transfer; GYAFC Entertainment & Music (test); BLEU: 78.75.

- [Formality Style Transfer on GYAFC Family & Relationships (test)](<https://www.sota2.com/research/sota/formality-style-transfer-on-gyafc-family-and-relationships-test.md>): Formality Style Transfer; GYAFC Family & Relationships (test); BLEU: 81.37.

- [Formality Style Transfer on GYAFC (test)](<https://www.sota2.com/research/sota/formality-style-transfer-on-gyafc-test.md>): Formality Style Transfer; GYAFC (test); Formality (E&M): 1.55.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2203.13620>)

[PDF](<https://arxiv.org/pdf/2203.13620.pdf>)

[Implementation](<https://github.com/Aolius/semi-fst>)
