Novel Generation on 10 novels of different genres medium-length ~4k words (test)
63.34RelevanceEx3
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Ex3Comparison Pair=vs Rolling-GPT2024.08 | 63.34 | 83.34 | 53.33 | 80 | 93.34 | 80 | 96.67 | |
| Ex3Comparison Pair=vs RE32024.08 | 63.33 | 56.67 | 53.33 | 70 | 53.33 | 63.33 | 73.33 | |
| Ex3Comparison Pair=vs DOC2024.08 | 50 | 66.67 | 73.33 | 66.67 | 60 | 46.67 | 80 | |
| Ex3Comparison Pair=vs RECURRENTGPT2024.08 | 46.67 | 70 | 66.67 | 86.67 | 80 | 83.33 | 100 | |
| DOCComparison Pair=vs Ex32024.08 | 40 | 30 | 23.33 | 40 | 23.33 | 26.67 | 33.33 | |
| RE3Comparison Pair=vs Ex32024.08 | 16.67 | 20 | 26.67 | 36.67 | 23.33 | 16.67 | 16.67 | |
| Rolling-GPTComparison Pair=vs Ex32024.08 | 13.34 | 6.67 | 0 | 10 | 6.67 | 6.67 | 10 | |
| RECURRENTGPTComparison Pair=vs Ex32024.08 | 3.33 | 3.33 | 3.33 | 0 | 26.67 | 0 | 0 |