Word Analogy on Google analogy task
38.2Semantic AccuracyCBOW
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CBOWembedding dimension=200, Trainable Parameters=200,000,0002026.06 | 38.2 | 65.6 | 58.3 | |
| HALO-CBOWembedding dimension=200, core vocabulary size=30000, Trainable Parameters=37,660,3222026.06 | 32.8 | 66.9 | 57.8 | |
| CBOWembedding dimension=100, Trainable Parameters=100,000,0002026.06 | 29.7 | 60.2 | 52.1 | |
| HALO-CBOWembedding dimension=200, core vocabulary size=20000, Trainable Parameters=33,660,3222026.06 | 28.9 | 62.5 | 53.6 | |
| HALO-CBOWembedding dimension=200, core vocabulary size=10000, Trainable Parameters=29,660,3222026.06 | 24 | 57.5 | 48.6 | |
| HALO-SGNSembedding dimension=200, core vocabulary size=20000, Trainable Parameters=33,660,3222026.06 | 22.3 | 51 | 43.4 | |
| CBOWembedding dimension=50, Trainable Parameters=50,000,0002026.06 | 18.5 | 43.8 | 37.1 |