Object Generation on ATOMIC
0.462BLEU-2HSN (50, 20)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| HSN (50, 20)Conditioning=Posterior (sees target object), K=50, L=20, Decoding=Greedy2022.07 | 0.462 | 0.694 | |
| COMET(BART)Backbone=BART, Framework=COMET, Decoding=Greedy2022.07 | 0.33 | 0.65 | |
| COMET(GPT2-XL)Backbone=GPT2-XL, Framework=COMET, Decoding=Greedy2022.07 | 0.3 | 0.638 | |
| COMET(GPT2)Backbone=GPT2, Framework=COMET, Decoding=Greedy2022.07 | 0.225 | 0.385 | |
| HSN AR (50, 20)Conditioning=Autoregressive reasoning (does not see target object), K=50, L=20, Decoding=Greedy2022.07 | 0.129 | 0.374 |