Word Concept Categorization on AP, Battig, ESSLI (test)
66.4AP ScoreContext-to-Vec
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Context-to-Vecstatus=final, post-processing=graph-based post-retrofitting2022.10 | 66.4 | 44.2 | 87.5 | 74.1 | 68.1 | |
| Context-to-Vecstatus=preliminary, post-processing=false2022.10 | 65.7 | 44 | 85 | 70.4 | 66.3 | |
| BERT+Skip-gram2022.10 | 64.1 | 43.8 | 77.5 | 66.6 | 63 | |
| Skip-gram2022.10 | 63.4 | 42.8 | 75 | 62.2 | 60.8 | |
| FASTTEXT2022.10 | 63.4 | 44.4 | 75 | 62.2 | 61.2 | |
| SynGCN2022.10 | 63.4 | 42.8 | 82.5 | 62.2 | 62.7 | |
| CBOW2022.10 | 63.2 | 43.3 | 75 | 64.4 | 61.4 | |
| Deps2022.10 | 61.8 | 41.7 | 77.5 | 68.8 | 62.4 | |
| Glove2022.10 | 58 | 41.3 | 72.5 | 60 | 58 | |
| Skip-gramcontext=true2022.10 | 57.4 | 41.6 | 72.5 | 66.6 | 59.5 | |
| BERTavg2022.10 | 55.7 | 34.7 | 70 | 64 | 56.1 |