Semantic Relatedness on SICK 2014 (test)
0.884Pearson's rInferSent
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| InferSentEvaluation Protocol=SentEval2018.08 | 0.884 | — | — | |
| HBMPEmbedding Dimension=600D, Evaluation Protocol=SentEval2018.08 | 0.876 | — | — | |
| HBMPEmbedding Dimension=1200D, Evaluation Protocol=SentEval2018.08 | 0.876 | — | — | |
| ReSAN2018.01 | 0.872 | 0.8163 | 0.2623 | |
| DISAN2018.01 | 0.8695 | 0.8139 | 0.2879 | |
| Dependency Tree-LSTMstructure=dependency tree2015.02 | 0.8676 | 0.8083 | 0.2532 | |
| Dep. Tree-LSTMtype=Dependency2018.01 | 0.8676 | 0.8083 | 0.2532 | |
| Dependency Tree-LSTM2017.07 | 0.8676 | 0.8083 | 0.2532 | |
| Dependency Tree-LSTMSource=Reported by [22]2015.06 | 0.8676 | 0.8083 | 0.2532 | |
| combine-skip+COCOAdditional Data=COCO2015.06 | 0.8655 | 0.7995 | 0.2561 | |
| combine-skip2017.07 | 0.8584 | 0.7916 | 0.2687 | |
| combine-skip2015.06 | 0.8584 | 0.7916 | 0.2687 | |
| Constituency Tree-LSTMstructure=constituency tree2015.02 | 0.8582 | 0.7966 | 0.2734 | |
| Cons. Tree-LSTMtype=Constituency2018.01 | 0.8582 | 0.7966 | 0.2734 | |
| SkipThoughtEvaluation Protocol=SentEval2018.08 | 0.858 | — | — | |
| Bi-GRU2018.01 | 0.8572 | 0.8026 | 0.3079 | |
| Bidirectional LSTMtype=Sequential LSTM, direction=bidirectional2015.02 | 0.8567 | 0.7966 | 0.2736 | |
| Bidirectional LSTM2017.07 | 0.8567 | 0.7966 | 0.2736 | |
| Bidirectional LSTMSource=Reported by [22]2015.06 | 0.8567 | 0.7966 | 0.2736 | |
| 2-layer Bidirectional LSTMtype=Sequential LSTM, layers=2, direction=bidirectional2015.02 | 0.8558 | 0.7965 | 0.2762 | |
| LSTMtype=Sequential LSTM2015.02 | 0.8528 | 0.7911 | 0.2831 | |
| LSTM2017.07 | 0.8528 | 0.7911 | 0.2831 | |
| LSTMSource=Reported by [22]2015.06 | 0.8528 | 0.7911 | 0.2831 | |
| Multi-head2018.01 | 0.8521 | 0.7942 | 0.3258 | |
| 2-layer LSTMtype=Sequential LSTM, layers=22015.02 | 0.8515 | 0.7896 | 0.2838 | |
| uni-skip2015.06 | 0.8477 | 0.778 | 0.2872 | |
| Bi-LSTM2018.01 | 0.8473 | 0.7913 | 0.3276 | |
| Hierarchical CNN2018.01 | 0.8436 | 0.7874 | 0.3162 | |
| ECNUtype=SemEval 2014 submission2015.02 | 0.8414 | — | — | |
| ECNU2018.01 | 0.8414 | — | — | |
| ECNUSource=SemEval 2014 submission2015.06 | 0.8414 | — | — | |
| bi-skip2015.06 | 0.8405 | 0.7696 | 0.2995 | |
| Doc2VecC2017.07 | 0.8381 | 0.7621 | 0.3053 | |
| Multi-window CNN2018.01 | 0.8374 | 0.7793 | 0.3395 | |
| ECNU2017.07 | 0.8279 | 0.7689 | 0.325 | |
| Meaning Factorytype=SemEval 2014 submission2015.02 | 0.8268 | 0.7721 | 0.3224 | |
| Meaning Factory2018.01 | 0.8268 | 0.7721 | 0.3224 | |
| Meaning Factory2017.07 | 0.8268 | 0.7721 | 0.3224 | |
| Meaning FactorySource=SemEval 2014 submission2015.06 | 0.8268 | 0.7721 | 0.3224 | |
| UNAL-NLPtype=SemEval 2014 submission2015.02 | 0.807 | 0.7489 | 0.355 | |
| UNAL-NLP2017.07 | 0.807 | 0.7489 | 0.355 | |
| UNAL-NLPSource=SemEval 2014 submission2015.06 | 0.807 | 0.7489 | 0.355 | |
| Illinois-LHtype=SemEval 2014 submission2015.02 | 0.7993 | 0.7538 | 0.3692 | |
| Illinois-LH2017.07 | 0.7993 | 0.7538 | 0.3692 | |
| Illinois-LHSource=SemEval 2014 submission2015.06 | 0.7993 | 0.7538 | 0.3692 | |
| DT-RNNtype=Baseline2015.02 | 0.7923 | 0.7319 | 0.3822 | |
| DT-RNN2018.01 | 0.7923 | 0.7319 | 0.3822 | |
| DT-RNN2017.07 | 0.7923 | 0.7319 | 0.3822 | |
| DT-RNNSource=Reported by [22]2015.06 | 0.7923 | 0.7319 | 0.3822 | |
| SDT-RNNtype=Baseline2015.02 | 0.79 | 0.7304 | 0.3848 | |
| SDT-RNN2018.01 | 0.79 | 0.7304 | 0.3848 | |
| SDT-RNN2017.07 | 0.79 | 0.7304 | 0.3848 | |
| SDT-RNNSource=Reported by [22]2015.06 | 0.79 | 0.7304 | 0.3848 | |
| Mean vectorstype=Baseline2015.02 | 0.7577 | 0.6738 | 0.4557 | |
| Mean vectorsEmbeddings=Word2Vec, Composition=Average2017.07 | 0.7577 | 0.6738 | 0.4557 | |
| Mean vectorsSource=Reported by [22]2015.06 | 0.7577 | 0.6738 | 0.4557 |