Response Selection on MWOZ 2.1
68.5Accuracy (1/100)FutureTOD
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FutureTODTraining data setting=Full Data2023.06 | 68.5 | 87.9 | |
| TOD-BERTTraining data setting=Full Data2023.06 | 65.8 | 87 | |
| SimCSETraining data setting=Full Data2023.06 | 64.2 | 85.4 | |
| DSETraining data setting=Full Data2023.06 | 63.3 | 85.3 | |
| FutureTODTraining data setting=10% Data2023.06 | 50 | 72.8 | |
| BERT-mlmTraining data setting=Full Data2023.06 | 48.1 | 74.3 | |
| BERTTraining data setting=Full Data2023.06 | 47.5 | 75.5 | |
| SimCSETraining data setting=10% Data2023.06 | 37.2 | 60.6 | |
| FutureTODTraining data setting=1% Data2023.06 | 35.8 | 53.5 | |
| DialoGPTTraining data setting=Full Data2023.06 | 35.7 | 64.1 | |
| DSETraining data setting=10% Data2023.06 | 24.8 | 49.4 | |
| BERT-mlmTraining data setting=10% Data2023.06 | 22.3 | 48.7 | |
| BERTTraining data setting=10% Data2023.06 | 20.9 | 45.4 | |
| SimCSETraining data setting=1% Data2023.06 | 17.2 | 32.6 | |
| BERT-mlmTraining data setting=1% Data2023.06 | 13 | 34.6 | |
| DSETraining data setting=1% Data2023.06 | 7.9 | 21.2 | |
| BERTTraining data setting=1% Data2023.06 | 7.8 | 20.5 |