Analogy on Universal Analogy Sentence
4.7Semantic AccuracyULR-BERT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ULR-BERTModel Size=LARGE2021.05 | 4.7 | 54.3 | 29.5 | |
| LASER2021.05 | 1.6 | 55.4 | 28.5 | |
| ULR-BERTModel Size=BASE2021.05 | 1.5 | 63 | 32.3 | |
| ELECTRAModel Size=LARGE2021.05 | 1.4 | 52 | 26.7 | |
| ULR-ELECTRAModel Size=BASE2021.05 | 0.9 | 57.6 | 29.3 | |
| ULR-ELECTRAModel Size=LARGE2021.05 | 0.8 | 52.9 | 26.9 | |
| ULR-ALBERTModel Size=XXLARGE2021.05 | 0.7 | 60.3 | 30.5 | |
| USE2021.05 | 0.6 | 44.1 | 22.4 | |
| BERTModel Size=LARGE2021.05 | 0.5 | 61.2 | 30.9 | |
| ALBERTModel Size=XXLARGE2021.05 | 0.4 | 49.4 | 24.9 | |
| ELECTRAModel Size=BASE2021.05 | 0.4 | 39.5 | 20 | |
| ULR-ALBERTModel Size=BASE2021.05 | 0.3 | 60.9 | 30.6 | |
| GloVe2021.05 | 0.2 | 39.8 | 20 | |
| BERTModel Size=BASE2021.05 | 0.1 | 68.3 | 34.2 | |
| ALBERTModel Size=BASE2021.05 | 0.1 | 60.9 | 30.5 | |
| InferSent2021.05 | 0 | 50.8 | 25.4 | |
| GenSen2021.05 | 0 | 44.9 | 22.4 |