Short Text Clustering on AgNews
88.2ACCSCCL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SCCLAveraging=Average over five random runs2021.03 | 88.2 | 68.2 | |
| GoldModel=gemma-2-27b-it, Prompt Order=T-C2024.06 | 85.4 | — | |
| RSTC-Icontrastive learning=instance-wise, clustering=k-means2023.05 | 85.39 | 62.79 | |
| llm2vec+KMeansModel=mistral-7b-it2024.06 | 84.4 | — | |
| ZeroDLModel=Qwen-2.5-7b-it, Prompt Order=T-C2024.06 | 84.3 | — | |
| RSTC2023.05 | 84.24 | 62.45 | |
| SCCL2023.05 | 83.1 | 61.96 | |
| IDASModel=Qwen-2.5-7b-it, Prompt Order=T-C2024.06 | 83.1 | — | |
| GoldModel=Qwen-2.5-7b-it, Prompt Order=T-C2024.06 | 82.9 | — | |
| GoldModel=mistral-7b-it, Prompt Order=T-C2024.06 | 82.7 | — | |
| HAC-SDAlgorithm=Hierarchical Agglomerative Clustering2021.03 | 81.8 | 54.6 | |
| ZeroDLModel=gemma-2-27b-it, Prompt Order=T-C2024.06 | 81.8 | — | |
| ZeroDLModel=mistral-7b-it, Prompt Order=T-C2024.06 | 79.5 | — | |
| RSTC-Ccontrastive learning=class-wise, pseudo-labels=SAOT2023.05 | 78.08 | 49.39 | |
| ZeroDLModel=mistral-7b-it, Prompt Order=C-T2024.06 | 75.2 | — | |
| ZeroDLModel=gemma-2-27b-it, Prompt Order=C-T2024.06 | 74.5 | — | |
| ZeroDLModel=Qwen-2.5-7b-it, Prompt Order=C-T2024.06 | 70.9 | — | |
| GoldModel=gemma-2-27b-it, Prompt Order=C-T2024.06 | 70.5 | — | |
| IDASModel=Qwen-2.5-7b-it, Prompt Order=C-T2024.06 | 68.8 | — | |
| K-means_IC2023.05 | 66.3 | 42.03 | |
| SBERT(k-means)2023.05 | 65.95 | 31.55 | |
| RSTC-OTpseudo-labels=traditional OT2023.05 | 65.94 | 41.86 | |
| GoldModel=Qwen-2.5-7b-it, Prompt Order=C-T2024.06 | 62.2 | — | |
| GoldModel=mistral-7b-it, Prompt Order=C-T2024.06 | 60.7 | — | |
| ZeroDLModel=hcx-seed-0.5b-it, Prompt Order=T-C2024.06 | 59.5 | — | |
| GoldModel=hcx-seed-0.5b-it, Prompt Order=T-C2024.06 | 59.4 | — | |
| IDASModel=mistral-7b-it, Prompt Order=T-C2024.06 | 44.6 | — | |
| IDASModel=mistral-7b-it, Prompt Order=C-T2024.06 | 38.1 | — | |
| IDASModel=gemma-2-27b-it, Prompt Order=T-C, Token Limit=81922024.06 | 35 | — | |
| TF-IDFFeature dimension=1500, Algorithm=K-means2021.03 | 34.5 | 11.9 | |
| TF-IDF2023.05 | 34.39 | 12.19 | |
| ZeroDLModel=hcx-seed-0.5b-it, Prompt Order=C-T2024.06 | 33.1 | — | |
| IDASModel=gemma-2-27b-it, Prompt Order=C-T, Token Limit=81922024.06 | 31.7 | — | |
| GoldModel=hcx-seed-0.5b-it, Prompt Order=C-T2024.06 | 31.4 | — | |
| IDASModel=hcx-seed-0.5b-it, Prompt Order=C-T, Token Limit=81922024.06 | 29.4 | — | |
| BOW2023.05 | 28.71 | 4.07 | |
| BoWFeature dimension=1500, Algorithm=K-means2021.03 | 27.6 | 2.6 | |
| IDASModel=hcx-seed-0.5b-it, Prompt Order=T-C, Token Limit=81922024.06 | 27.3 | — |