Dialogue Generation on MuTual (dev)
54.5MRRKID
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| KIDBackbone=BART-large, Parameters=406M, Evaluation Protocol=fine-tuned, Decoding Strategy=KID2022.04 | 54.5 | 22.7 | |
| BART-largeBackbone=BART-large, Parameters=406M, Evaluation Protocol=fine-tuned, Decoding Strategy=Sampling2022.04 | 53.7 | 20.4 | |
| KIDBackbone=GPT2-medium, Parameters=345M, Evaluation Protocol=fine-tuned, Decoding Strategy=KID2022.04 | 53.3 | 22.4 | |
| GPT2-mediumBackbone=GPT2-medium, Parameters=345M, Evaluation Protocol=fine-tuned, Decoding Strategy=Sampling2022.04 | 51.6 | 20.3 | |
| BART-largeBackbone=BART-large, Parameters=406M, Evaluation Protocol=fine-tuned, Decoding Strategy=Beam2022.04 | 49.2 | 20.6 | |
| GPT2-mediumBackbone=GPT2-medium, Parameters=345M, Evaluation Protocol=fine-tuned, Decoding Strategy=Beam2022.04 | 47.9 | 11.3 | |
| BART-largeBackbone=BART-large, Parameters=406M, Evaluation Protocol=zero-shot2022.04 | 35.1 | 12.9 | |
| GPT2-mediumBackbone=GPT2-medium, Parameters=345M, Evaluation Protocol=zero-shot2022.04 | 29.7 | 7.1 |