Language Generation Evaluation on BAGEL (test)
0.298InformativenessWMD-1+BERT+PMEANS
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| WMD-1+BERT+PMEANSCategory=Baselines2022.03 | 0.298 | 0.212 | 0.163 | |
| WMD-1+BERT+MNLI+PMEANSCategory=Baselines2022.03 | 0.285 | 0.195 | 0.158 | |
| SMD+BERT+MNLI+PMAENSCategory=Baselines2022.03 | 0.28 | 0.149 | 0.12 | |
| BERTScoreCategory=Baselines2022.03 | 0.267 | 0.21 | 0.178 | |
| WMD-1+ELMO+PMEANSCategory=Baselines2022.03 | 0.261 | 0.163 | 0.148 | |
| METEORCategory=Baselines2022.03 | 0.251 | 0.127 | 0.116 | |
| SMD+ELMO+PMEANSCategory=Baselines2022.03 | 0.251 | 0.171 | 0.147 | |
| BLEU-1Category=Baselines2022.03 | 0.225 | 0.141 | 0.113 | |
| BLEU-2Category=Baselines2022.03 | 0.211 | 0.152 | 0.115 | |
| RoMeBackbone=ALBERT-large2022.03 | 0.17 | 0.274 | 0.241 | |
| RoMeBackbone=ALBERT-base2022.03 | 0.162 | 0.259 | 0.222 | |
| RoMeBackbone=BERT2022.03 | 0.16 | 0.251 | 0.202 | |
| RoMeEmbedding=Fasttext2022.03 | 0.112 | 0.163 | 0.132 | |
| SMD+W2VCategory=Baselines2022.03 | 0.024 | 0.074 | 0.078 |