Storytelling on RocStories 8:1:1 (test)
0.3552BLEU-1Ours (Hierarchical Contrastive Learning Framework)
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Ours (Hierarchical Contrastive Learning Framework)backbone=BERT, beam search size=42022.05 | 0.3552 | 0.1341 | 0.0485 | 0.0184 | 0.5218 | 0.5884 | 0.6131 | |
| T5-CLAPSbackbone=T5, beam search size=42022.05 | 0.342 | 0.1261 | 0.0452 | 0.0176 | 0.5232 | 0.588 | 0.6134 | |
| T5backbone=T5, beam search size=42022.05 | 0.3274 | 0.1177 | 0.0416 | 0.0164 | 0.5194 | 0.5864 | 0.6118 | |
| DialoGPTbeam search size=42022.05 | 0.3126 | 0.1105 | 0.0398 | 0.0158 | 0.5178 | 0.586 | 0.6103 | |
| Seq2Seq-DUbeam search size=42022.05 | 0.3089 | 0.1131 | 0.0384 | 0.0156 | 0.5166 | 0.5773 | 0.6116 | |
| BERT-GENbackbone=BERT, beam search size=42022.05 | 0.304 | 0.1071 | 0.0385 | 0.0153 | 0.5173 | 0.5866 | 0.6098 | |
| Group-wisebeam search size=42022.05 | 0.2748 | 0.1017 | 0.0366 | 0.0152 | 0.5139 | 0.5651 | 0.6009 | |
| CVAEbeam search size=42022.05 | 0.2581 | 0.0969 | 0.036 | 0.0148 | 0.5135 | 0.5632 | 0.6011 | |
| Transformerbeam search size=42022.05 | 0.2552 | 0.0596 | 0.0354 | 0.0145 | 0.5129 | 0.5637 | 0.6006 | |
| Seq2Seqbeam search size=42022.05 | 0.2324 | 0.0896 | 0.034 | 0.015 | 0.5133 | 0.5649 | 0.6007 |