User Intent Detection on ChattyChef (test) benchmark leaderboard · SOTA2 Research

User Intent Detection on ChattyChef (test)

78.3Micro F1T5-XL (SGD -> CookDial -> ChattyChef)

Evaluation Results

Method	Links
T5-XL (SGD -> CookDial -> ChattyChef)2023.05		78.3
T5-XL (MultiWOZ -> CookDial -> ChattyChef)2023.05		77.7
T5-XL (MultiWOZ -> CookDial -> ChattyChef)2023.05		76.6
T5-XL (SGD -> CookDial -> ChattyChef)2023.05		76.5
T5-XL (CookDial -> ChattyChef)2023.05		74.5
T5-XL (MultiWOZ -> CookDial -> ChattyChef)2023.05		73.9
T5-XL (SGD -> CookDial -> ChattyChef)2023.05		73.7
T5-XL (CookDial -> ChattyChef)2023.05		72.8
T5-XL (CookDial -> ChattyChef)2023.05		72.3
T5-XL (SGD -> ChattyChef)2023.05		66.9
T5-XL (MultiWOZ -> ChattyChef)2023.05		65.1
In-context (GPT-J)2023.05		40.2
T5-XL (MultiWOZ -> ChattyChef)2023.05		36.2
T5-XL (SGD -> ChattyChef)2023.05		34.9
T5-XL (None -> ChattyChef)2023.05		32
T5-XL (SGD -> ChattyChef)2023.05		21.5
T5-XL (MultiWOZ -> ChattyChef)2023.05		14.2
T5-XL (None -> ChattyChef)2023.05		7.5