Word Similarity on WordSim-353
0.7Spearman RhoROOTROOT-CA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ROOTROOT-CAp=0, k (dimensionality)=800, Training Corpus (Text8, BNC, Wiki052024)=Wiki0520242024.05 | 0.7 | — | |
| ROOTROOT-CAp=0.5, k (dimensionality)=300, Training Corpus (Text8, BNC, Wiki052024)=Text82024.05 | 0.697 | — | |
| PPMI-SVDp=0.5, k (dimensionality)=200, Training Corpus (Text8, BNC, Wiki052024)=Text82024.05 | 0.694 | — | |
| ROOTROOT-CAp=0, k (dimensionality)=200, Training Corpus (Text8, BNC, Wiki052024)=Text82024.05 | 0.692 | — | |
| PPMI-SVDp=0.5, k (dimensionality)=900, Training Corpus (Text8, BNC, Wiki052024)=Wiki0520242024.05 | 0.688 | — | |
| ROOT-CAp=0.5, k (dimensionality)=500, Training Corpus (Text8, BNC, Wiki052024)=Text82024.05 | 0.688 | — | |
| HALO-CBOWembedding dimension=200, core vocabulary size=20000, Trainable Parameters=33,660,3222026.06 | 0.686 | — | |
| HALO-CBOWembedding dimension=200, core vocabulary size=30000, Trainable Parameters=37,660,3222026.06 | 0.686 | — | |
| ROOT-CCAp=0.5, k (dimensionality)=300, Training Corpus (Text8, BNC, Wiki052024)=Text82024.05 | 0.684 | — | |
| PMI-SVDp=0.5, k (dimensionality)=400, Training Corpus (Text8, BNC, Wiki052024)=Text82024.05 | 0.683 | — | |
| ROOT-CCAp=0, k (dimensionality)=100, Training Corpus (Text8, BNC, Wiki052024)=Text82024.05 | 0.682 | — | |
| ROOT-CAp=0.5, k (dimensionality)=600, Training Corpus (Text8, BNC, Wiki052024)=Wiki0520242024.05 | 0.682 | — | |
| PPMI-SVDp=0, k (dimensionality)=400, Training Corpus (Text8, BNC, Wiki052024)=Text82024.05 | 0.681 | — | |
| ROOT-CCAp=0.5, k (dimensionality)=600, Training Corpus (Text8, BNC, Wiki052024)=Wiki0520242024.05 | 0.681 | — | |
| ROOTROOT-CAp=0.5, k (dimensionality)=800, Training Corpus (Text8, BNC, Wiki052024)=Wiki0520242024.05 | 0.679 | — | |
| HALO-CBOWembedding dimension=200, core vocabulary size=10000, Trainable Parameters=29,660,3222026.06 | 0.677 | — | |
| PMI-SVDp=0, k (dimensionality)=400, Training Corpus (Text8, BNC, Wiki052024)=Text82024.05 | 0.675 | — | |
| PPMI-SVDp=0, k (dimensionality)=700, Training Corpus (Text8, BNC, Wiki052024)=Wiki0520242024.05 | 0.672 | — | |
| ROOT-CAp=0, k (dimensionality)=500, Training Corpus (Text8, BNC, Wiki052024)=Wiki0520242024.05 | 0.669 | — | |
| SGNSp=0, k (dimensionality)=300, Training Corpus (Text8, BNC, Wiki052024)=Text82024.05 | 0.668 | — | |
| ROOT-CAp=0, k (dimensionality)=300, Training Corpus (Text8, BNC, Wiki052024)=Text82024.05 | 0.668 | — | |
| SGNSp=0.5, k (dimensionality)=300, Training Corpus (Text8, BNC, Wiki052024)=Text82024.05 | 0.668 | — | |
| ROOT-CCAp=0, k (dimensionality)=400, Training Corpus (Text8, BNC, Wiki052024)=Wiki0520242024.05 | 0.667 | — | |
| GloVep=0, k (dimensionality)=600, Training Corpus (Text8, BNC, Wiki052024)=Wiki0520242024.05 | 0.663 | — | |
| GloVep=0.5, k (dimensionality)=600, Training Corpus (Text8, BNC, Wiki052024)=Wiki0520242024.05 | 0.663 | — | |
| HALO-SGNSembedding dimension=200, core vocabulary size=20000, Trainable Parameters=33,660,3222026.06 | 0.658 | — | |
| ROOT-CAp=0.5, k (dimensionality)=900, Training Corpus (Text8, BNC, Wiki052024)=BNC2024.05 | 0.657 | — | |
| SGNSp=0, k (dimensionality)=600, Training Corpus (Text8, BNC, Wiki052024)=Wiki0520242024.05 | 0.654 | — | |
| SGNSp=0.5, k (dimensionality)=600, Training Corpus (Text8, BNC, Wiki052024)=Wiki0520242024.05 | 0.654 | — | |
| CBOWembedding dimension=100, Trainable Parameters=100,000,0002026.06 | 0.639 | — | |
| ROOTROOT-CAp=0, k (dimensionality)=200, Training Corpus (Text8, BNC, Wiki052024)=BNC2024.05 | 0.635 | — | |
| ROOTROOT-CAp=0.5, k (dimensionality)=400, Training Corpus (Text8, BNC, Wiki052024)=BNC2024.05 | 0.63 | — | |
| PMI-SVDp=0, k (dimensionality)=600, Training Corpus (Text8, BNC, Wiki052024)=BNC2024.05 | 0.628 | — | |
| PPMI-SVDp=0, k (dimensionality)=700, Training Corpus (Text8, BNC, Wiki052024)=BNC2024.05 | 0.628 | — | |
| ROOT-CCAp=0, k (dimensionality)=700, Training Corpus (Text8, BNC, Wiki052024)=BNC2024.05 | 0.627 | — | |
| PMI-SVDp=0, k (dimensionality)=200, Training Corpus (Text8, BNC, Wiki052024)=Wiki0520242024.05 | 0.624 | — | |
| ROOT-CAp=0, k (dimensionality)=400, Training Corpus (Text8, BNC, Wiki052024)=BNC2024.05 | 0.623 | — | |
| PPMI-SVDp=0.5, k (dimensionality)=2000, Training Corpus (Text8, BNC, Wiki052024)=BNC2024.05 | 0.623 | — | |
| ROOT-CCAp=0.5, k (dimensionality)=600, Training Corpus (Text8, BNC, Wiki052024)=BNC2024.05 | 0.62 | — | |
| CBOWembedding dimension=50, Trainable Parameters=50,000,0002026.06 | 0.616 | — | |
| RAW-CAp=0.5, k (dimensionality)=9000, Training Corpus (Text8, BNC, Wiki052024)=Text82024.05 | 0.609 | — | |
| CBOWembedding dimension=200, Trainable Parameters=200,000,0002026.06 | 0.609 | — | |
| PMI-SVDp=0.5, k (dimensionality)=500, Training Corpus (Text8, BNC, Wiki052024)=Wiki0520242024.05 | 0.597 | — | |
| PMI-GSVDp=0.5, k (dimensionality)=900, Training Corpus (Text8, BNC, Wiki052024)=Wiki0520242024.05 | 0.586 | — | |
| PMI-SVDp=0.5, k (dimensionality)=500, Training Corpus (Text8, BNC, Wiki052024)=BNC2024.05 | 0.579 | — | |
| RAW-CAp=0, k (dimensionality)=600, Training Corpus (Text8, BNC, Wiki052024)=Text82024.05 | 0.578 | — | |
| PMI-GSVDp=0, k (dimensionality)=400, Training Corpus (Text8, BNC, Wiki052024)=Wiki0520242024.05 | 0.572 | — | |
| SGNSp=0, k (dimensionality)=600, Training Corpus (Text8, BNC, Wiki052024)=BNC2024.05 | 0.551 | — | |
| SGNSp=0.5, k (dimensionality)=600, Training Corpus (Text8, BNC, Wiki052024)=BNC2024.05 | 0.551 | — | |
| PMI-GSVDp=0.5, k (dimensionality)=6000, Training Corpus (Text8, BNC, Wiki052024)=Text82024.05 | 0.548 | — | |
| RAW-CAp=0.5, k (dimensionality)=6000, Training Corpus (Text8, BNC, Wiki052024)=Wiki0520242024.05 | 0.535 | — | |
| GloVep=0, k (dimensionality)=600, Training Corpus (Text8, BNC, Wiki052024)=BNC2024.05 | 0.522 | — | |
| GloVep=0.5, k (dimensionality)=600, Training Corpus (Text8, BNC, Wiki052024)=BNC2024.05 | 0.522 | — | |
| PMI-GSVDp=0, k (dimensionality)=700, Training Corpus (Text8, BNC, Wiki052024)=Text82024.05 | 0.512 | — | |
| RAW-CAp=0.5, k (dimensionality)=10000, Training Corpus (Text8, BNC, Wiki052024)=BNC2024.05 | 0.498 | — | |
| RAW-CAp=0, k (dimensionality)=800, Training Corpus (Text8, BNC, Wiki052024)=Wiki0520242024.05 | 0.493 | — | |
| PMI-GSVDp=0, k (dimensionality)=600, Training Corpus (Text8, BNC, Wiki052024)=BNC2024.05 | 0.468 | — | |
| RAW-CAp=0, k (dimensionality)=400, Training Corpus (Text8, BNC, Wiki052024)=BNC2024.05 | 0.465 | — | |
| PMI-GSVDp=0.5, k (dimensionality)=3000, Training Corpus (Text8, BNC, Wiki052024)=BNC2024.05 | 0.449 | — | |
| GloVep=0, k (dimensionality)=200, Training Corpus (Text8, BNC, Wiki052024)=Text82024.05 | 0.422 | — | |
| GloVep=0.5, k (dimensionality)=200, Training Corpus (Text8, BNC, Wiki052024)=Text82024.05 | 0.422 | — | |
| ConceptsModel=Llama 3.1 8B, λ=1.02026.03 | 0.3071 | — | |
| ConceptsModel=Llama 3.1 8B, λ=1.02026.03 | 0.3008 | — | |
| ConceptsModel=Llama 3.1 8B, λ=0.752026.03 | 0.2906 | — | |
| ConceptsModel=Llama 3.1 8B, λ=0.52026.03 | 0.2842 | — | |
| ConceptsModel=Llama 3.1 8B, λ=0.752026.03 | 0.2774 | — | |
| ConceptsModel=Llama 3.2 3B, λ=1.02026.03 | 0.2733 | — | |
| ConceptsModel=Llama 3.1 8B, λ=0.252026.03 | 0.2712 | — | |
| ConceptsModel=Llama 3.2 3B, λ=1.02026.03 | 0.2696 | — | |
| ConceptsModel=Llama 3.2 1B, λ=1.02026.03 | 0.2693 | — | |
| ConceptsModel=Llama 3.2 1B, λ=1.02026.03 | 0.2659 | — | |
| ConceptsModel=Llama 3.1 8B, λ=0.52026.03 | 0.2657 | — | |
| ConceptsModel=Llama 3.1 8B, λ=0.252026.03 | 0.2595 | — | |
| BaselineModel=Llama 3.1 8B, λ=0.02026.03 | 0.2566 | — | |
| ConceptsModel=Llama 3.2 1B, λ=0.752026.03 | 0.2557 | — | |
| ConceptsModel=Llama 3.2 1B, λ=0.752026.03 | 0.2518 | — | |
| ConceptsModel=Llama 3.2 1B, λ=0.52026.03 | 0.2509 | — | |
| ConceptsModel=Llama 3.1 8B, λ=0.02026.03 | 0.2482 | — | |
| ConceptsModel=Llama 3.2 3B, λ=0.752026.03 | 0.2481 | — | |
| ConceptsModel=Llama 3.2 3B, λ=0.752026.03 | 0.2462 | — | |
| ConceptsModel=Llama 3.2 1B, λ=0.52026.03 | 0.2461 | — | |
| BaselineModel=Llama 3.1 8B, λ=Base2026.03 | 0.2381 | — | |
| BaselineModel=Llama 3.1 8B, λ=Base2026.03 | 0.2381 | — | |
| ConceptsModel=Llama 3.2 1B, λ=0.252026.03 | 0.2371 | — | |
| ConceptsModel=Llama 3.2 3B, λ=0.52026.03 | 0.2365 | — | |
| ConceptsModel=Llama 3.2 1B, λ=0.252026.03 | 0.236 | — | |
| ConceptsModel=Llama 3.2 3B, λ=0.52026.03 | 0.234 | — | |
| ConceptsModel=Llama 3.2 3B, λ=0.252026.03 | 0.2279 | — | |
| NoiseModel=Llama 3.1 8B, λ=0.252026.03 | 0.2249 | — | |
| ConceptsModel=Llama 3.2 1B, λ=0.02026.03 | 0.2242 | — | |
| ConceptsModel=Llama 3.2 3B, λ=0.252026.03 | 0.2238 | — | |
| BaselineModel=Llama 3.2 1B, λ=Base2026.03 | 0.2211 | — | |
| BaselineModel=Llama 3.2 1B, λ=Base2026.03 | 0.2211 | — | |
| BaselineModel=Llama 3.2 1B, λ=0.02026.03 | 0.2199 | — | |
| BaselineModel=Llama 3.2 3B, λ=0.02026.03 | 0.2158 | — | |
| ConceptsModel=Llama 3.2 3B, λ=0.02026.03 | 0.2074 | — | |
| NoiseModel=Llama 3.2 1B, λ=0.252026.03 | 0.202 | — | |
| BaselineModel=Llama 3.2 3B, λ=Base2026.03 | 0.2017 | — | |
| NoiseModel=Llama 3.1 8B, λ=0.52026.03 | 0.2017 | — | |
| BaselineModel=Llama 3.2 3B, λ=Base2026.03 | 0.2017 | — |