Abductive Natural Language Generation on aNLG (dev)
45ROUGE-LT5
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| T5Role=Published SotA2022.04 | 45 | — | |
| KIDBackbone=BART-large, Parameters=406M, Evaluation Protocol=fine-tuned, Decoding Strategy=KID2022.04 | 35.6 | 33.4 | |
| BART-largeBackbone=BART-large, Parameters=406M, Evaluation Protocol=fine-tuned, Decoding Strategy=Beam2022.04 | 34.1 | 31.9 | |
| BART-largeBackbone=BART-large, Parameters=406M, Evaluation Protocol=fine-tuned, Decoding Strategy=Sampling2022.04 | 33.6 | 30.5 | |
| BART-largeBackbone=BART-large, Parameters=406M, Evaluation Protocol=zero-shot2022.04 | 28 | 24.6 | |
| KIDBackbone=GPT2-medium, Parameters=345M, Evaluation Protocol=fine-tuned, Decoding Strategy=KID2022.04 | 26.9 | 21.7 | |
| GPT2-mediumBackbone=GPT2-medium, Parameters=345M, Evaluation Protocol=fine-tuned, Decoding Strategy=Beam2022.04 | 25.7 | 19.4 | |
| GPT2-mediumBackbone=GPT2-medium, Parameters=345M, Evaluation Protocol=fine-tuned, Decoding Strategy=Sampling2022.04 | 25.1 | 18.9 | |
| GPT2-mediumBackbone=GPT2-medium, Parameters=345M, Evaluation Protocol=zero-shot2022.04 | 15 | 13.2 |