# Dialogue Generation on DailyDialog Multi-reference

Source: [Dialogue Generation on DailyDialog Multi-reference](<https://www.sota2.com/research/sota/dialogue-generation-on-dailydialog-multi-reference>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:37:12.873Z

Evaluation of dialogue response generation performance on the DailyDialog Multi-reference dataset, measured using BLEU, Distinctness (DIST), and BLEURT scores.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Dialogue Generation |
| Dataset (including any stated split) | DailyDialog Multi-reference |
| Metric | BLEU-1 |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 16 of 16 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [BLEU-1](<https://www.sota2.com/research/sota/dialogue-generation-on-dailydialog-multi-reference.md?metric=BLEU-1>): Higher is better; unit: SCALAR.

- [BLEU-2](<https://www.sota2.com/research/sota/dialogue-generation-on-dailydialog-multi-reference.md?metric=BLEU-2>): Higher is better; unit: SCALAR.

- [BLEU-3](<https://www.sota2.com/research/sota/dialogue-generation-on-dailydialog-multi-reference.md?metric=BLEU-3>): Higher is better; unit: SCALAR.

- [BLEU-4](<https://www.sota2.com/research/sota/dialogue-generation-on-dailydialog-multi-reference.md?metric=BLEU-4>): Higher is better; unit: SCALAR.

- [Distinct-1](<https://www.sota2.com/research/sota/dialogue-generation-on-dailydialog-multi-reference.md?metric=Distinct-1>): Higher is better; unit: SCALAR.

- [Distinct-2](<https://www.sota2.com/research/sota/dialogue-generation-on-dailydialog-multi-reference.md?metric=Distinct-2>): Higher is better; unit: SCALAR.

- [BLEURT](<https://www.sota2.com/research/sota/dialogue-generation-on-dailydialog-multi-reference.md?metric=BLEURT>): Higher is better; unit: SCALAR.

## Recorded results

| Method | BLEU-1 | Result date | Report paper |
| --- | --- | --- | --- |
| DialoGPS | 38.46 | Not recorded | 68fa6feb1e209131cea48261 |
| DialoGPS | 38.42 | Not recorded | 68fa6feb1e209131cea48261 |
| DialoGPS | 38.38 | Not recorded | 68fa6feb1e209131cea48261 |
| DialoGPS | 38.27 | Not recorded | 68fa6feb1e209131cea48261 |
| DialoGPS | 38.05 | Not recorded | 68fa6feb1e209131cea48261 |
| DialoGPS | 38.04 | Not recorded | 68fa6feb1e209131cea48261 |
| DialoGPS | 38.01 | Not recorded | 68fa6feb1e209131cea48261 |
| DialoGPS | 37.21 | Not recorded | 68fa6feb1e209131cea48261 |
| M&D-D | 36.97 | Not recorded | 68fa6feb1e209131cea48261 |
| DD++ | 36.87 | Not recorded | 68fa6feb1e209131cea48261 |
| TSA | 36.14 | Not recorded | 68fa6feb1e209131cea48261 |
| DialoGPS | 34.62 | Not recorded | 68fa6feb1e209131cea48261 |
| DialoGPS | 34.49 | Not recorded | 68fa6feb1e209131cea48261 |
| ResBag | 34.1 | Not recorded | 68fa6feb1e209131cea48261 |
| Transformer | 33.93 | Not recorded | 68fa6feb1e209131cea48261 |
| DialoGPS | 33.93 | Not recorded | 68fa6feb1e209131cea48261 |

### DialoGPS

BLEU-1: 38.46. Result ID: 699102523a6c31484904fcc4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

Recorded evaluation configuration: {"K (Neighbor size)":8,"Decoding scheme":"Top-5 Sampling"}. This record does not assert independent reproduction.

### DialoGPS

BLEU-1: 38.42. Result ID: 699102523a6c31484904fcc9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

Recorded evaluation configuration: {"K (Neighbor size)":4,"Mixup in encoder (M.E.)":false,"Mixup in decoder (M.D.)":true,"Optimizing f\_theta (Brown.)":false}. This record does not assert independent reproduction.

### DialoGPS

BLEU-1: 38.38. Result ID: 699102523a6c31484904fcc5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

Recorded evaluation configuration: {"K (Neighbor size)":16,"Decoding scheme":"Top-5 Sampling"}. This record does not assert independent reproduction.

### DialoGPS

BLEU-1: 38.27. Result ID: 699102523a6c31484904fcc3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

Recorded evaluation configuration: {"K (Neighbor size)":4,"Decoding scheme":"Top-5 Sampling"}. This record does not assert independent reproduction.

### DialoGPS

BLEU-1: 38.05. Result ID: 699102523a6c31484904fcc8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

Recorded evaluation configuration: {"K (Neighbor size)":4,"Mixup in encoder (M.E.)":true,"Mixup in decoder (M.D.)":true,"Optimizing f\_theta (Brown.)":false}. This record does not assert independent reproduction.

### DialoGPS

BLEU-1: 38.04. Result ID: 699102523a6c31484904fcc6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

Recorded evaluation configuration: {"K (Neighbor size)":4,"Mixup in encoder (M.E.)":false,"Mixup in decoder (M.D.)":true,"Optimizing f\_theta (Brown.)":true}. This record does not assert independent reproduction.

### DialoGPS

BLEU-1: 38.01. Result ID: 699102523a6c31484904fcc2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

Recorded evaluation configuration: {"K (Neighbor size)":2,"Decoding scheme":"Top-5 Sampling"}. This record does not assert independent reproduction.

### DialoGPS

BLEU-1: 37.21. Result ID: 699102523a6c31484904fcc1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

Recorded evaluation configuration: {"K (Neighbor size)":1,"Decoding scheme":"Top-5 Sampling"}. This record does not assert independent reproduction.

### M&D-D

BLEU-1: 36.97. Result ID: 699102523a6c31484904fcc0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68be1e209131cea1dfa3.md>)

Recorded evaluation configuration: {"Decoding scheme":"Top-5 Sampling"}. This record does not assert independent reproduction.

### DD++

BLEU-1: 36.87. Result ID: 699102523a6c31484904fcbf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68691e209131cea1bf5b.md>)

Recorded evaluation configuration: {"Decoding scheme":"Top-5 Sampling"}. This record does not assert independent reproduction.

### TSA

BLEU-1: 36.14. Result ID: 699102523a6c31484904fcbe.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

Recorded evaluation configuration: {"Decoding scheme":"Top-5 Sampling"}. This record does not assert independent reproduction.

### DialoGPS

BLEU-1: 34.62. Result ID: 699102523a6c31484904fcc7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

Recorded evaluation configuration: {"K (Neighbor size)":4,"Mixup in encoder (M.E.)":true,"Mixup in decoder (M.D.)":false,"Optimizing f\_theta (Brown.)":true}. This record does not assert independent reproduction.

### DialoGPS

BLEU-1: 34.49. Result ID: 699102523a6c31484904fcca.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

Recorded evaluation configuration: {"K (Neighbor size)":4,"Mixup in encoder (M.E.)":true,"Mixup in decoder (M.D.)":false,"Optimizing f\_theta (Brown.)":false}. This record does not assert independent reproduction.

### ResBag

BLEU-1: 34.1. Result ID: 699102523a6c31484904fcbd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

Recorded evaluation configuration: {"Decoding scheme":"Top-5 Sampling"}. This record does not assert independent reproduction.

### Transformer

BLEU-1: 33.93. Result ID: 699102523a6c31484904fcbc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa703d1e209131cea49db1.md>)

[Implementation](<https://github.com/tensorflow/tensor2tensor>)

Recorded evaluation configuration: {"Decoding scheme":"Top-5 Sampling"}. This record does not assert independent reproduction.

### DialoGPS

BLEU-1: 33.93. Result ID: 699102523a6c31484904fccb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6feb1e209131cea48261.md>)

Recorded evaluation configuration: {"K (Neighbor size)":4,"Mixup in encoder (M.E.)":false,"Mixup in decoder (M.D.)":false,"Optimizing f\_theta (Brown.)":true}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
