Long Novel Generation on 10 Novels of Different Genres (Long ~10k words)
86.21RelevanceEx3
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Ex3Comparison Context=Pairwise vs Rolling-GPT2024.08 | 86.21 | 75.86 | 89.66 | 96.56 | 75.87 | 82.76 | 93.1 | |
| Ex3Comparison Context=Pairwise vs RE32024.08 | 74.19 | 51.61 | 74.2 | 74.2 | 54.84 | 64.52 | 64.52 | |
| Ex3Comparison Context=Pairwise vs DOC2024.08 | 65.63 | 50 | 53.13 | 59.38 | 53.13 | 62.5 | 65.63 | |
| Ex3Comparison Context=Pairwise vs RECURRENTGPT2024.08 | 55.17 | 86.21 | 34.48 | 82.76 | 68.97 | 68.97 | 96.55 | |
| RECURRENTGPTComparison Context=Pairwise vs Ex32024.08 | 34.48 | 6.9 | 6.9 | 0 | 10.34 | 6.9 | 0 | |
| DOCComparison Context=Pairwise vs Ex32024.08 | 15.63 | 15.63 | 31.25 | 25 | 15.63 | 21.88 | 25.01 | |
| RE3Comparison Context=Pairwise vs Ex32024.08 | 12.9 | 25.81 | 9.68 | 25.8 | 25.81 | 19.35 | 29.03 | |
| Rolling-GPTComparison Context=Pairwise vs Ex32024.08 | 0 | 13.79 | 3.45 | 10.35 | 6.9 | 6.9 | 17.24 |