Story Generation on ROC (test)
37.5Fluency Win RateHINT
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| HINTManual Evaluation Protocol=Pair-wise comparison, Comparison Baseline=BART2021.05 | 37.5 | 24 | 38.5 | 0.58 | 54.5 | 11 | 34.5 | 0.59 | |
| HINTManual Evaluation Protocol=Pair-wise comparison, Comparison Baseline=HINT w/o Sen2021.05 | 37 | 31 | 32 | 0.68 | 47.5 | 23 | 29.5 | 0.67 | |
| HINTManual Evaluation Protocol=Pair-wise comparison, Comparison Baseline=BART-Post2021.05 | 35.5 | 21 | 43.5 | 0.63 | 47.5 | 21.5 | 31 | 0.62 | |
| HINTManual Evaluation Protocol=Pair-wise comparison, Comparison Baseline=HINT w/o Sen&Dis2021.05 | 35.5 | 28.5 | 36 | 0.6 | 55.5 | 24 | 20.5 | 0.58 | |
| HINTManual Evaluation Protocol=Pair-wise comparison, Comparison Baseline=HINT w/o Dis2021.05 | 33 | 25.5 | 41.5 | 0.62 | 42 | 28 | 30 | 0.63 |