Task-oriented Dialog Generation on In-Car Assistant (test)
13.5BLEUHuman*
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Human*source=reported from Eric et al., 20172018.04 | 13.5 | 60.7 | 64.3 | 61.6 | 55.2 | |
| KV Retrieval Net*source=reported from Eric et al., 20172018.04 | 13.2 | 48 | 62.9 | 47 | 41.3 | |
| Mem2Seqhops=32018.04 | 12.6 | 33.4 | 49.3 | 32.8 | 20 | |
| Mem2Seqhops=12018.04 | 11.6 | 32.4 | 39.8 | 33.6 | 24.6 | |
| Mem2Seqhops=62018.04 | 9.9 | 23.6 | 34.3 | 33 | 4.4 | |
| Seq2Seqattention=true2018.04 | 9.3 | 19.9 | 23.4 | 25.6 | 10.8 | |
| Seq2Seqattention=false2018.04 | 8.4 | 10.3 | 9.7 | 14.1 | 7 | |
| Ptr-Unk2018.04 | 8.3 | 22.7 | 26.9 | 26.7 | 14.9 | |
| Rule-Based*source=reported from Eric et al., 20172018.04 | 6.6 | 43.8 | 61.3 | 39.5 | 40.4 |