Task-oriented dialogue on SMCalFlow (test)
64.29SacreBLEUNoisy channel online decoding
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Noisy channel online decodingPre-training=Task-Oriented Pretraining, Number of Parameters=292M2021.03 | 64.29 | 45.81 | |
| Noisy channel online decodingPre-training=Reddit Pretraining, Number of Parameters=292M2021.03 | 63.91 | 46.43 | |
| Noisy channel online decodingPre-training=Task-Oriented Pretraining, Number of Parameters=116M2021.03 | 63.72 | 46.27 | |
| Noisy channel online decodingPre-training=Reddit Pretraining, Number of Parameters=116M2021.03 | 63.29 | 47.16 | |
| Direct decodingPre-training=Task-Oriented Pretraining, Number of Parameters=114M2021.03 | 61.02 | 59.84 | |
| Direct decodingPre-training=Reddit Pretraining, Number of Parameters=114M2021.03 | 60.68 | 61.99 | |
| Noisy channel online decodingPre-training=Randomly Initialized, Number of Parameters=292M2021.03 | 54.39 | 73.18 | |
| Noisy channel online decodingPre-training=Randomly Initialized, Number of Parameters=116M2021.03 | 53.66 | 74.18 | |
| Direct decodingPre-training=Randomly Initialized, Number of Parameters=114M2021.03 | 51.3 | 89.13 |