Clustering on OpenWebText
0.6222Clustering ScoreConcepts
Evaluation results
| Method | Links | |
|---|---|---|
| ConceptsModel=Llama 3.1 8B, λ=0.52026.03 | 0.6222 | |
| ConceptsModel=Llama 3.1 8B, λ=0.252026.03 | 0.6203 | |
| BaselineModel=Llama 3.1 8B, λ=Base2026.03 | 0.62 | |
| ConceptsModel=Llama 3.1 8B, λ=0.752026.03 | 0.6168 | |
| BaselineModel=Llama 3.1 8B, λ=0.02026.03 | 0.6078 | |
| ConceptsModel=Llama 3.1 8B, λ=1.02026.03 | 0.5832 | |
| ConceptsModel=Llama 3.2 3B, λ=0.752026.03 | 0.5528 | |
| ConceptsModel=Llama 3.2 1B, λ=1.02026.03 | 0.5516 | |
| ConceptsModel=Llama 3.2 3B, λ=1.02026.03 | 0.5482 | |
| ConceptsModel=Llama 3.2 3B, λ=0.52026.03 | 0.5402 | |
| BaselineModel=Llama 3.2 3B, λ=Base2026.03 | 0.5247 | |
| ConceptsModel=Llama 3.2 3B, λ=0.252026.03 | 0.523 | |
| ConceptsModel=Llama 3.2 1B, λ=0.752026.03 | 0.5172 | |
| BaselineModel=Llama 3.2 3B, λ=0.02026.03 | 0.4997 | |
| ConceptsModel=Llama 3.2 1B, λ=0.52026.03 | 0.4942 | |
| ConceptsModel=Llama 3.2 1B, λ=0.252026.03 | 0.4712 | |
| BaselineModel=Llama 3.2 1B, λ=Base2026.03 | 0.4474 | |
| BaselineModel=Llama 3.2 1B, λ=0.02026.03 | 0.4451 | |
| NoiseModel=Llama 3.1 8B, λ=0.252026.03 | 0.4253 | |
| NoiseModel=Llama 3.1 8B, λ=0.52026.03 | 0.3482 | |
| NoiseModel=Llama 3.2 3B, λ=0.252026.03 | 0.3194 | |
| NoiseModel=Llama 3.2 1B, λ=0.252026.03 | 0.2712 | |
| NoiseModel=Llama 3.1 8B, λ=0.752026.03 | 0.2619 | |
| NoiseModel=Llama 3.2 3B, λ=0.52026.03 | 0.258 | |
| NoiseModel=Llama 3.2 1B, λ=0.52026.03 | 0.2147 | |
| NoiseModel=Llama 3.2 3B, λ=0.752026.03 | 0.1916 | |
| NoiseModel=Llama 3.2 1B, λ=0.752026.03 | 0.1566 | |
| NoiseModel=Llama 3.1 8B, λ=1.02026.03 | 0.0076 | |
| NoiseModel=Llama 3.2 3B, λ=1.02026.03 | 0.0054 | |
| NoiseModel=Llama 3.2 1B, λ=1.02026.03 | 0.0033 |