Story Generation on TVSTORYGEN Fandom (test)
100BLEUReference
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ReferenceModel Type=Return Baseline, Inputs=reference2021.09 | 100 | 100 | 100 | 100 | 12.9 | |
| Oracle plot + summary + oracle char. desc.Model Type=Neural Model (NN), Selection Strategy=Oracle, Inputs=plot + summary + oracle char. desc.2021.09 | 28.4 | 63.2 | 32.9 | 61.5 | 18.2 | |
| Nearest neighbour plot + summary + char. desc.Model Type=Neural Model (NN), Selection Strategy=Nearest neighbour, Inputs=plot + summary + char. desc.2021.09 | 6 | 41.7 | 10.7 | 40.3 | 28 | |
| Oracle plot + summaryModel Type=Return Baseline, Selection Strategy=Oracle, Inputs=plot + summary2021.09 | 5.4 | 48.5 | 20.5 | 46.2 | — | |
| Nearest neighbour detailed recapModel Type=Return Baseline, Selection Strategy=Nearest neighbour, Inputs=detailed recap2021.09 | 5.1 | 41.1 | 9.3 | 39.6 | 31.2 | |
| Oracle nearest neighbour detailed recapModel Type=Return Baseline, Selection Strategy=Oracle nearest neighbour, Inputs=detailed recap2021.09 | 4.8 | 41.2 | 10.8 | 39.9 | 28.5 | |
| Oracle plotModel Type=Return Baseline, Selection Strategy=Oracle, Inputs=plot2021.09 | 3.6 | 43.9 | 19.7 | 41.9 | — | |
| Oracle plot + oracle char. desc.Model Type=Return Baseline, Selection Strategy=Oracle, Inputs=plot + oracle char. desc.2021.09 | 1.2 | 11 | 4.6 | 10.6 | — | |
| Oracle plot + oracle char. desc. + summaryModel Type=Return Baseline, Selection Strategy=Oracle, Inputs=plot + oracle char. desc. + summary2021.09 | 1.2 | 11 | 4.7 | 10.6 | — |