Dialogue Intent Clustering on Chinese dialogue intent dataset (test)
11.76NMI GainLLM-ITL + role + merge
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LLM-ITL + role + mergeContext Setting=Context-Aware, Dialogue Role Incorporation=true, Cluster Merging=true2024.12 | 11.76 | — | — | 2.95 | |
| LLM-ITL + roleContext Setting=Context-Aware, Dialogue Role Incorporation=true2024.12 | 9.86 | — | — | 2.53 | |
| LLM-ITL + mergeContext Setting=Context-Aware, Cluster Merging=true2024.12 | 6.59 | — | — | 3.16 | |
| LLM-ITL + keyphraseContext Setting=Context-Free, Keyphrase Augmentation=true2024.12 | 6.06 | — | — | 1.69 | |
| KeyphraseCategory=LLM-Guided Clustering Baselines2024.12 | 5.97 | — | — | -0.32 | |
| LLM-ITL (convex)Context Setting=Context-Free, Sampling Strategy=convex2024.12 | 3.92 | — | — | 3.16 | |
| LLM-ITL (random)Context Setting=Context-Free, Sampling Strategy=random2024.12 | 3.84 | — | — | 3.06 | |
| IDASCategory=LLM-Guided Clustering Baselines2024.12 | 2.66 | — | — | -1.27 | |
| HierarchicalCategory=Baselines2024.12 | 1.29 | — | — | 0.11 | |
| GMMsCategory=Baselines2024.12 | 0.05 | — | — | -3.9 | |
| LLMEdgeRefineCategory=LLM-Guided Clustering Baselines2024.12 | -6.19 | — | — | -8.02 | |
| ClusterLLMCategory=LLM-Guided Clustering Baselines2024.12 | -7.79 | — | — | -3.8 |