Empathetic Response Generation on EmpatheticDialogues (test)
0.54CoverageBlender
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| BlenderStrategy=Focused S12021.09 | 0.54 | — | — | — | 0.38 | 0.26 | |
| DodecaTransformerStrategy=Focused S12021.09 | 0.49 | — | — | — | 0.32 | 0.3 | |
| DodecaTransformerStrategy=Plain S12021.09 | 0.43 | — | — | — | 0.3 | 0.23 | |
| BlenderStrategy=Plain S12021.09 | 0.43 | — | — | — | 0.37 | 0.21 | |
| BlenderStrategy=S02021.09 | 0.35 | — | — | — | 0.28 | 0.22 | |
| DodecaTransformerStrategy=S02021.09 | 0.34 | — | — | — | 0.25 | 0.24 | |
| DodecaTransformerStrategy=S0+Emotion2021.09 | 0.34 | — | — | — | 0.21 | 0.2 | |
| BlenderStrategy=S0+Emotion2021.09 | 0.34 | — | — | — | 0.31 | 0.2 | |
| MIMEStrategy=Focused S12021.09 | 0.24 | — | — | — | 0.24 | 0.13 | |
| MIMEStrategy=S02021.09 | 0.22 | — | — | — | 0.12 | 0.05 | |
| MIMEStrategy=Plain S12021.09 | 0.22 | — | — | — | 0.23 | 0.1 | |
| BlenderApproach=S0 (base speaker)2021.09 | — | 2.91 | 3.12 | 3.46 | — | — | |
| DodecaTransformerApproach=S0 (base speaker)2021.09 | — | 2.53 | 3.47 | 2.56 | — | — | |
| Focused S1Backbone=MIME2021.09 | — | 3.09 | 3.21 | 2.83 | — | — | |
| Focused S1Backbone=DodecaTransformer2021.09 | — | 2.71 | 3.57 | 2.75 | — | — | |
| Focused S1Backbone=Blender2021.09 | — | 3 | 3.25 | 3.57 | — | — | |
| MIMEApproach=S0 (base speaker)2021.09 | — | 2.94 | 3.17 | 2.75 | — | — |