Diversity Measurement Correlation on Instruction-tuning (IT) datasets Qwen-2.5-7B performance
0.9Average CorrelationNovelSum
Evaluation results
| Method | Links | |
|---|---|---|
| NovelSum2025.02 | 0.9 | |
| Cluster Inertia2025.02 | 0.76 | |
| KNN Distance2025.02 | 0.67 | |
| Entropy2025.02 | 0.63 | |
| LDD2025.02 | 0.6 | |
| Vendi Score2025.02 | 0.6 | |
| DistSum cosine2025.02 | 0.51 | |
| DistSum L22025.02 | 0.51 | |
| Radius2025.02 | 0.48 | |
| Facility Loc.2025.02 | 0.08 | |
| TTR2025.02 | -0.3 | |
| vocd-D2025.02 | -0.31 |