Text Clustering on SST-2
91.1AccuracyIDAS
Evaluation Results
| Method | Links | |
|---|---|---|
| IDASModel=gemma-2-27b-it, Prompt Order=C-T, Token Limit=81922024.06 | 91.1 | |
| GoldModel=gemma-2-27b-it, Prompt Order=T-C2024.06 | 89.6 | |
| IDASModel=gemma-2-27b-it, Prompt Order=T-C, Token Limit=81922024.06 | 89.2 | |
| IDASModel=Qwen-2.5-7b-it, Prompt Order=T-C2024.06 | 88.9 | |
| GoldModel=Qwen-2.5-7b-it, Prompt Order=T-C2024.06 | 88.5 | |
| ZeroDLModel=gemma-2-27b-it, Prompt Order=T-C2024.06 | 88.3 | |
| ZeroDLModel=gemma-2-27b-it, Prompt Order=C-T2024.06 | 88 | |
| GoldModel=Qwen-2.5-7b-it, Prompt Order=C-T2024.06 | 87.4 | |
| IDASModel=Qwen-2.5-7b-it, Prompt Order=C-T2024.06 | 87.3 | |
| GoldModel=gemma-2-27b-it, Prompt Order=C-T2024.06 | 86.3 | |
| ZeroDLModel=mistral-7b-it, Prompt Order=C-T2024.06 | 85.7 | |
| ZeroDLModel=Qwen-2.5-7b-it, Prompt Order=T-C2024.06 | 85.2 | |
| ZeroDLModel=mistral-7b-it, Prompt Order=T-C2024.06 | 84.2 | |
| GoldModel=mistral-7b-it, Prompt Order=T-C2024.06 | 82.5 | |
| GoldModel=mistral-7b-it, Prompt Order=C-T2024.06 | 77 | |
| GoldModel=hcx-seed-0.5b-it, Prompt Order=C-T2024.06 | 75.2 | |
| IDASModel=hcx-seed-0.5b-it, Prompt Order=C-T, Token Limit=81922024.06 | 74.9 | |
| ZeroDLModel=Qwen-2.5-7b-it, Prompt Order=C-T2024.06 | 74.8 | |
| GoldModel=hcx-seed-0.5b-it, Prompt Order=T-C2024.06 | 73.7 | |
| ZeroDLModel=hcx-seed-0.5b-it, Prompt Order=T-C2024.06 | 72.2 | |
| IDASModel=mistral-7b-it, Prompt Order=T-C2024.06 | 68.1 | |
| IDASModel=mistral-7b-it, Prompt Order=C-T2024.06 | 63.1 | |
| IDASModel=hcx-seed-0.5b-it, Prompt Order=T-C, Token Limit=81922024.06 | 62.9 | |
| ZeroDLModel=hcx-seed-0.5b-it, Prompt Order=C-T2024.06 | 62.5 | |
| llm2vec+KMeansModel=mistral-7b-it2024.06 | 55.2 |