Clustering on Massive-D
78AccuracyAgentic clustering
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Agentic clusteringk setting=Given k, predicted number of clusters (ˆk)=18, total cost ($)=$100 + $222026.05 | 78 | 78 | 71 | |
| Agentic clusteringk setting=Discover k, predicted number of clusters (ˆk)=20, total cost ($)=$100 + $232026.05 | 73 | 77 | 67 | |
| LLM-embedding+k-meansk setting=Given k, predicted number of clusters (ˆk)=18, total cost ($)=$0.392026.05 | 62 | 70 | 49 | |
| BERTopick setting=Given k, predicted number of clusters (ˆk)=18, total cost ($)=$02026.05 | 61 | 64 | 48 | |
| ClusterLLMk setting=Given k, predicted number of clusters (ˆk)=18, total cost ($)=$1.532026.05 | 59 | 68 | 44 | |
| LLM-MemClusterIn-context learning=true, Model=GPT-4.1 mini2025.11 | 57.6 | 67.7 | 53.8 | |
| SBERT+k-meansk setting=Given k, predicted number of clusters (ˆk)=18, total cost ($)=$02026.05 | 56 | 63 | 42 | |
| K-Means-InstEmbeddings=instructor-large2025.11 | 54.9 | 66.9 | 42.7 | |
| SpectralEmbeddings=instructor-large2025.11 | 54.1 | 64.7 | 33 | |
| BERTopicEmbeddings=instructor-large2025.11 | 52.6 | 56.2 | 29.3 | |
| ClusterLLMEmbeddings=instructor-large, Guidance Model=GPT-4.1 mini2025.11 | 52.4 | 65.3 | 40.8 | |
| K-Means-TF-IDFEmbeddings=TF-IDF2025.11 | 43.9 | 44.2 | 10.5 | |
| TopicGPTk setting=Discover k, predicted number of clusters (ˆk)=12, total cost ($)=$100 + $662026.05 | 43 | 45 | 18 | |
| BERTopick setting=Discover k, predicted number of clusters (ˆk)=67, total cost ($)=$02026.05 | 36 | 64 | 27 | |
| LDAk setting=Given k, predicted number of clusters (ˆk)=18, total cost ($)=$02026.05 | 31 | 26 | 17 | |
| DBSCANEmbeddings=instructor-large2025.11 | 25.9 | 30.7 | 6.4 | |
| Huang & Hek setting=Discover k, predicted number of clusters (ˆk)=476, total cost ($)=$100 + $442026.05 | 17 | 61 | 12 |