Dialogue Generation on DSTC-8 Reddit (test)
12.56R-L ScoreSECOND THOUGHTS (AEM + VM default)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SECOND THOUGHTS (AEM + VM default)variant=AEM + VM (default)2023.01 | 12.56 | 12.4 | |
| SECOND THOUGHTS (AEM + AIL)variant=AEM + AIL2023.01 | 11.31 | 12.85 | |
| SECOND THOUGHTS (AEM Only)variant=AEM Only2023.01 | 9.8 | 11.56 | |
| InstructGPTService=Huge LM API service2023.01 | 8.8 | 10.57 | |
| GPT-3Service=Huge LM API service2023.01 | 7.31 | 11.44 |