Language Generation Evaluation on SFHOTEL (test)
0.244InformativenessRoMe
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| RoMeBackbone=ALBERT-large2022.03 | 0.244 | 0.32 | 0.327 | |
| RoMeBackbone=ALBERT-base2022.03 | 0.231 | 0.295 | 0.315 | |
| RoMeBackbone=BERT2022.03 | 0.212 | 0.283 | 0.3 | |
| WMD-1+BERT+MNLI+PMEANSCategory=Baselines2022.03 | 0.207 | 0.27 | 0.183 | |
| SMD+BERT+MNLI+PMAENSCategory=Baselines2022.03 | 0.205 | 0.239 | 0.147 | |
| WMD-1+BERT+PMEANSCategory=Baselines2022.03 | 0.203 | 0.261 | 0.182 | |
| RoMeEmbedding=Fasttext2022.03 | 0.172 | 0.19 | 0.231 | |
| METEORCategory=Baselines2022.03 | 0.163 | 0.193 | 0.118 | |
| BERTScoreCategory=Baselines2022.03 | 0.163 | 0.193 | 0.118 | |
| WMD-1+ELMO+PMEANSCategory=Baselines2022.03 | 0.147 | 0.215 | 0.136 | |
| SMD+ELMO+PMEANSCategory=Baselines2022.03 | 0.13 | 0.176 | 0.096 | |
| BLEU-1Category=Baselines2022.03 | 0.107 | 0.175 | 0.069 | |
| BLEU-2Category=Baselines2022.03 | 0.097 | 0.174 | 0.071 | |
| SMD+W2VCategory=Baselines2022.03 | 0.022 | 0.025 | 0.011 |