User Intent Detection on ChattyChef (test)
78.3Micro F1T5-XL (SGD -> CookDial -> ChattyChef)
Evaluation results
| Method | Links | |
|---|---|---|
| T5-XL (SGD -> CookDial -> ChattyChef)Shot=128-shot2023.05 | 78.3 | |
| T5-XL (MultiWOZ -> CookDial -> ChattyChef)Shot=128-shot2023.05 | 77.7 | |
| T5-XL (MultiWOZ -> CookDial -> ChattyChef)Shot=16-shot2023.05 | 76.6 | |
| T5-XL (SGD -> CookDial -> ChattyChef)Shot=16-shot2023.05 | 76.5 | |
| T5-XL (CookDial -> ChattyChef)Shot=128-shot2023.05 | 74.5 | |
| T5-XL (MultiWOZ -> CookDial -> ChattyChef)Shot=0-shot2023.05 | 73.9 | |
| T5-XL (SGD -> CookDial -> ChattyChef)Shot=0-shot2023.05 | 73.7 | |
| T5-XL (CookDial -> ChattyChef)Shot=16-shot2023.05 | 72.8 | |
| T5-XL (CookDial -> ChattyChef)Shot=0-shot2023.05 | 72.3 | |
| T5-XL (SGD -> ChattyChef)Shot=128-shot2023.05 | 66.9 | |
| T5-XL (MultiWOZ -> ChattyChef)Shot=128-shot2023.05 | 65.1 | |
| In-context (GPT-J)Shot=16-shot2023.05 | 40.2 | |
| T5-XL (MultiWOZ -> ChattyChef)Shot=16-shot2023.05 | 36.2 | |
| T5-XL (SGD -> ChattyChef)Shot=16-shot2023.05 | 34.9 | |
| T5-XL (None -> ChattyChef)Shot=128-shot2023.05 | 32 | |
| T5-XL (SGD -> ChattyChef)Shot=0-shot2023.05 | 21.5 | |
| T5-XL (MultiWOZ -> ChattyChef)Shot=0-shot2023.05 | 14.2 | |
| T5-XL (None -> ChattyChef)Shot=16-shot2023.05 | 7.5 |