Clustering on IMDB
95.3AccuracyIDAS
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| IDASModel=Qwen-2.5-7b-it, Prompt Order=T-C, Zero-shot=true2024.06 | 95.3 | — | — | — | |
| IDASModel=gemma-2-27b-it, Prompt Order=C-T, Zero-shot=true, Token Limit=81922024.06 | 95.3 | — | — | — | |
| GoldModel=gemma-2-27b-it, Prompt Order=T-C, Zero-shot=true2024.06 | 95.3 | — | — | — | |
| IDASModel=gemma-2-27b-it, Prompt Order=T-C, Zero-shot=true, Token Limit=81922024.06 | 95.2 | — | — | — | |
| GoldModel=Qwen-2.5-7b-it, Prompt Order=T-C, Zero-shot=true2024.06 | 94.7 | — | — | — | |
| ZeroDLModel=gemma-2-27b-it, Prompt Order=C-T, Zero-shot=true2024.06 | 94.3 | — | — | — | |
| ZeroDLModel=gemma-2-27b-it, Prompt Order=T-C, Zero-shot=true2024.06 | 94 | — | — | — | |
| ZeroDLModel=Qwen-2.5-7b-it, Prompt Order=T-C, Zero-shot=true2024.06 | 93.5 | — | — | — | |
| IDASModel=Qwen-2.5-7b-it, Prompt Order=C-T, Zero-shot=true2024.06 | 93.3 | — | — | — | |
| GoldModel=mistral-7b-it, Prompt Order=T-C, Zero-shot=true2024.06 | 91.7 | — | — | — | |
| ZeroDLModel=mistral-7b-it, Prompt Order=T-C, Zero-shot=true2024.06 | 90.2 | — | — | — | |
| IDASModel=hcx-seed-0.5b-it, Prompt Order=T-C, Zero-shot=true, Token Limit=81922024.06 | 89.4 | — | — | — | |
| GoldModel=hcx-seed-0.5b-it, Prompt Order=T-C, Zero-shot=true2024.06 | 89.1 | — | — | — | |
| ZeroDLModel=mistral-7b-it, Prompt Order=C-T, Zero-shot=true2024.06 | 88.8 | — | — | — | |
| IDASModel=hcx-seed-0.5b-it, Prompt Order=C-T, Zero-shot=true, Token Limit=81922024.06 | 88.3 | — | — | — | |
| ZeroDLModel=Qwen-2.5-7b-it, Prompt Order=C-T, Zero-shot=true2024.06 | 87.6 | — | — | — | |
| GoldModel=mistral-7b-it, Prompt Order=C-T, Zero-shot=true2024.06 | 87.5 | — | — | — | |
| ZeroDLModel=hcx-seed-0.5b-it, Prompt Order=T-C, Zero-shot=true2024.06 | 86.7 | — | — | — | |
| GoldModel=Qwen-2.5-7b-it, Prompt Order=C-T, Zero-shot=true2024.06 | 84.3 | — | — | — | |
| GoldModel=gemma-2-27b-it, Prompt Order=C-T, Zero-shot=true2024.06 | 79.8 | — | — | — | |
| GoldModel=hcx-seed-0.5b-it, Prompt Order=C-T, Zero-shot=true2024.06 | 72.1 | — | — | — | |
| llm2vec+KMeansModel=mistral-7b-it, Zero-shot=true2024.06 | 62.1 | — | — | — | |
| MCGC2021.10 | 61.82 | 0.1149 | 0.1833 | 44.01 | |
| MCGCvariant=*2021.10 | 61.13 | 0.1225 | 0.1811 | 45.12 | |
| ZeroDLModel=hcx-seed-0.5b-it, Prompt Order=C-T, Zero-shot=true2024.06 | 56.2 | — | — | — | |
| IDASModel=mistral-7b-it, Prompt Order=C-T, Zero-shot=true2024.06 | 51.1 | — | — | — | |
| IDASModel=mistral-7b-it, Prompt Order=T-C, Zero-shot=true2024.06 | 50.1 | — | — | — | |
| PMNE2021.10 | 49.58 | 0.0359 | 0.0366 | 39.06 | |
| O2MA2021.10 | 46.97 | 0.0524 | 0.0753 | 42.29 | |
| O2MAC2021.10 | 45.02 | 0.0421 | 0.0564 | 14.59 | |
| GAE2021.10 | 42.98 | 0.0402 | 0.0473 | 40.62 | |
| LINE2021.10 | 42.68 | 0.0031 | -0.009 | 28.7 | |
| RMSC2021.10 | 27.02 | 0.3775 | 0.0054 | 0.18 | |
| SWMC2021.10 | 24.53 | 0.0023 | 0.0017 | 31.64 | |
| DMGIClustering method=K-means2022.10 | — | 3.49 | 2.65 | — | |
| H-DCClustering method=K-means2022.10 | — | 1.57 | 1.12 | — | |
| HDGIClustering method=K-means2022.10 | — | 4.15 | 2.96 | — | |
| HeCoClustering method=K-means2022.10 | — | 5.69 | 2.32 | — | |
| M2VClustering method=K-means2022.10 | — | 1.43 | 1.03 | — | |
| SHGPClustering method=K-means2022.10 | — | 6.33 | 3.1 | — |