# Dialogue Distillation: Open-Domain Dialogue Augmentation Using Unpaired Data

Source: [Dialogue Distillation: Open-Domain Dialogue Augmentation Using Unpaired Data](<https://www.sota2.com/research/paper/68fa68be1e209131cea1dfa3>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T22:44:52.991Z

Authors: Rongsheng Zhang, Yinhe Zheng, Jianzhi Shao, Xiaoxi Mao, Yadong Xi, Minlie Huang

Published: 2020-09-20T13:06:38.000Z

## Abstract

Recent advances in open-domain dialogue systems rely on the success of neural models that are trained on large-scale data. However, collecting large-scale dialogue data is usually time-consuming and labor-intensive. To address this data dilemma, we propose a novel data augmentation method for training open-domain dialogue models by utilizing unpaired data. Specifically, a data-level distillation process is first proposed to construct augmented dialogues where both post and response are retrieved from the unpaired data. A ranking module is employed to filter out low-quality dialogues. Further, a model-level distillation process is employed to distill a teacher model trained on high-quality paired data to augmented dialogue pairs, thereby preventing dialogue models from being affected by the noise in the augmented data. Automatic and manual evaluation indicates that our method can produce high-quality dialogue pairs with diverse contents, and the proposed data-level and model-level dialogue distillation can improve the performance of competitive baselines.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Dialogue Coherence on PersonaChat](<https://www.sota2.com/research/sota/dialogue-coherence-on-personachat.md>): Dialogue Coherence; PersonaChat; QuantiDCE: 2.96.

- [Dialogue Generation on PersonaChat](<https://www.sota2.com/research/sota/dialogue-generation-on-personachat.md>): Dialogue Generation; PersonaChat; BLEU-1: 18.42.

- [Dialogue Coherence on DailyDialog](<https://www.sota2.com/research/sota/dialogue-coherence-on-dailydialog.md>): Dialogue Coherence; DailyDialog; QuantiDCE: 3.13.

- [Dialogue Generation on DailyDialog Multi-reference](<https://www.sota2.com/research/sota/dialogue-generation-on-dailydialog-multi-reference.md>): Dialogue Generation; DailyDialog Multi-reference; BLEU-1: 36.97.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2009.09427>)

[PDF](<https://arxiv.org/pdf/2009.09427.pdf>)
