Text Clustering on Aggregate
80Macro ScoreGold
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GoldModel=gemma-2-27b-it, Prompt Order=T-C2024.06 | 80 | 81 | |
| GoldModel=Qwen-2.5-7b-it, Prompt Order=T-C2024.06 | 77.5 | 78.6 | |
| GoldModel=gemma-2-27b-it, Prompt Order=C-T2024.06 | 72.4 | 75.9 | |
| GoldModel=mistral-7b-it, Prompt Order=T-C2024.06 | 71.5 | 72.7 | |
| ZeroDLModel=Qwen-2.5-7b-it, Prompt Order=T-C2024.06 | 70.3 | 68.2 | |
| GoldModel=Qwen-2.5-7b-it, Prompt Order=C-T2024.06 | 69.2 | 71.3 | |
| ZeroDLModel=gemma-2-27b-it, Prompt Order=T-C2024.06 | 67.4 | 62.7 | |
| ZeroDLModel=Qwen-2.5-7b-it, Prompt Order=C-T2024.06 | 65 | 65.8 | |
| ZeroDLModel=mistral-7b-it, Prompt Order=T-C2024.06 | 64.8 | 63 | |
| GoldModel=mistral-7b-it, Prompt Order=C-T2024.06 | 64.5 | 68.1 | |
| ZeroDLModel=gemma-2-27b-it, Prompt Order=C-T2024.06 | 64.2 | 60.1 | |
| ZeroDLModel=mistral-7b-it, Prompt Order=C-T2024.06 | 63.4 | 61.5 | |
| IDASModel=Qwen-2.5-7b-it, Prompt Order=T-C2024.06 | 63 | 62.7 | |
| llm2vec+KMeansModel=mistral-7b-it2024.06 | 61 | 67.5 | |
| IDASModel=Qwen-2.5-7b-it, Prompt Order=C-T2024.06 | 58.9 | 59 | |
| GoldModel=hcx-seed-0.5b-it, Prompt Order=T-C2024.06 | 56.7 | 56.3 | |
| ZeroDLModel=hcx-seed-0.5b-it, Prompt Order=T-C2024.06 | 47.2 | 46.4 | |
| IDASModel=mistral-7b-it, Prompt Order=T-C2024.06 | 42.9 | 38.9 | |
| IDASModel=mistral-7b-it, Prompt Order=C-T2024.06 | 39.7 | 35.4 | |
| GoldModel=hcx-seed-0.5b-it, Prompt Order=C-T2024.06 | 37 | 33.6 | |
| ZeroDLModel=hcx-seed-0.5b-it, Prompt Order=C-T2024.06 | 31.4 | 33.1 |