Story Generation on TVMegaSite TVSTORYGEN (test)
100BLEU Score(Return) Reference
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| (Return) Referencemodel_category=return-input baseline, input_context=Reference2021.09 | 100 | 100 | 100 | 100 | 13.9 | |
| (NN) Oracle plot + summary + oracle char. desc.model_category=neural model, input_context=Oracle plot + summary + oracle char. desc.2021.09 | 28.1 | 67 | 40.9 | 66.2 | 18.3 | |
| (Return) Oracle plot + summarymodel_category=return-input baseline, input_context=Oracle plot + summary2021.09 | 13.6 | 62.9 | 25.6 | 62 | — | |
| (Return) Oracle nearest neighbour detailed recapmodel_category=return-input baseline, input_context=Oracle nearest neighbour detailed recap2021.09 | 7.5 | 49.9 | 18.5 | 49.3 | 25.8 | |
| (NN) Nearest neighbour plot + summary + char. desc.model_category=neural model, input_context=Nearest neighbour plot + summary + char. desc.2021.09 | 7.3 | 50.6 | 17.6 | 49.8 | 25.3 | |
| (Return) Oracle plotmodel_category=return-input baseline, input_context=Oracle plot2021.09 | 7.1 | 53.1 | 22.3 | 52.4 | — | |
| (Return) Nearest neighbour detailed recapmodel_category=return-input baseline, input_context=Nearest neighbour detailed recap2021.09 | 6.6 | 49.8 | 16 | 49.2 | 26.3 | |
| (Return) Oracle plot + oracle char. desc. + summarymodel_category=return-input baseline, input_context=Oracle plot + oracle char. desc. + summary2021.09 | 1.2 | 12.4 | 5.1 | 12 | — | |
| (Return) Oracle plot + oracle char. desc.model_category=return-input baseline, input_context=Oracle plot + oracle char. desc.2021.09 | 1.1 | 12.3 | 5.1 | 11.9 | — |