Paraphrase Identification on TwitterPara (test)
81.6TURLSBERT-supervised
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SBERT-supervisedMethod Category=In-domain supervised2021.04 | 81.6 | 75.8 | 78.7 | |
| USE-largeMethod Category=Out-of-the-box supervised2021.04 | 77.1 | 69.8 | 73.5 | |
| TSDAETraining Strategy=Unsupervised learning2021.04 | 76.8 | 69.2 | 73 | |
| BERT-flowTraining Strategy=Domain adaptation, Protocol=NLI+STS → target task2021.04 | 76.5 | 67.4 | 72 | |
| CTTraining Strategy=Domain adaptation, Protocol=target task → NLI+STS2021.04 | 75.9 | 68.9 | 72.4 | |
| SBERT-base-nli-stsb-v2Method Category=Out-of-the-box supervised2021.04 | 75.9 | 68.5 | 72.2 | |
| TSDAETraining Strategy=Domain adaptation, Protocol=NLI+STS → target task2021.04 | 75.8 | 66.2 | 71 | |
| TSDAETraining Strategy=Domain adaptation, Protocol=target task → NLI+STS2021.04 | 75.8 | 73.1 | 74.5 | |
| CTTraining Strategy=Domain adaptation, Protocol=NLI+STS → target task2021.04 | 75.6 | 70.6 | 73.1 | |
| SimCSETraining Strategy=Domain adaptation, Protocol=target task → NLI+STS2021.04 | 75.5 | 67.3 | 71.4 | |
| SBERT-base-nli-v2Method Category=Out-of-the-box supervised2021.04 | 75.4 | 69.9 | 72.7 | |
| MLMTraining Strategy=Domain adaptation, Protocol=target task → NLI+STS2021.04 | 75 | 68.6 | 71.8 | |
| CTTraining Strategy=Unsupervised learning2021.04 | 74.6 | 70.4 | 72.5 | |
| SimCSETraining Strategy=Unsupervised learning2021.04 | 74.5 | 62.5 | 68.5 | |
| SimCSETraining Strategy=Domain adaptation, Protocol=NLI+STS → target task2021.04 | 73.4 | 65.9 | 69.7 | |
| BERT-flowTraining Strategy=Unsupervised learning2021.04 | 72.8 | 65.7 | 69.3 | |
| MLMTraining Strategy=Unsupervised learning2021.04 | 71.9 | 69.7 | 70.8 | |
| BM25Method Category=Classical IR2021.04 | 71.9 | 70.5 | 71.2 | |
| Avg. GloVeMethod Category=Unsupervised2021.04 | 70.1 | 52.1 | 61.1 | |
| MLMTraining Strategy=Domain adaptation, Protocol=NLI+STS → target task2021.04 | 69.8 | 68.1 | 69 | |
| BERT-base-uncasedMethod Category=Unsupervised2021.04 | 69.1 | 61.7 | 65.4 | |
| Sent2VecMethod Category=Unsupervised2021.04 | 47.5 | 39.9 | 43.7 |