Question Retrieval on AskUbuntu (dev)
63.8APSBERT-supervised
Evaluation Results
| Method | Links | |
|---|---|---|
| SBERT-supervisedMethod Category=In-domain supervised (Upper bound)2021.04 | 63.8 | |
| MLMTraining Strategy=Domain adaptation, Protocol=target task → NLI+STS2021.04 | 60.6 | |
| TSDAETraining Strategy=Unsupervised learning, Backbone=BERT-base2021.04 | 59.4 | |
| TSDAETraining Strategy=Domain adaptation, Protocol=target task → NLI+STS2021.04 | 59.4 | |
| USE-largeMethod Category=Out-of-the-box supervised, Note=Trained with in-domain training data for this dataset2021.04 | 59.3 | |
| TSDAETraining Strategy=Domain adaptation, Protocol=NLI+STS → target task2021.04 | 58.7 | |
| BERT-flowTraining Strategy=Domain adaptation, Protocol=NLI+STS → target task2021.04 | 58.2 | |
| CTTraining Strategy=Domain adaptation, Protocol=NLI+STS → target task2021.04 | 57.9 | |
| SimCSETraining Strategy=Domain adaptation, Protocol=NLI+STS → target task2021.04 | 56.6 | |
| CTTraining Strategy=Domain adaptation, Protocol=target task → NLI+STS2021.04 | 56.4 | |
| CTTraining Strategy=Unsupervised learning, Backbone=BERT-base2021.04 | 56.3 | |
| SimCSETraining Strategy=Domain adaptation, Protocol=target task → NLI+STS2021.04 | 56.2 | |
| SimCSETraining Strategy=Unsupervised learning, Backbone=BERT-base2021.04 | 55.9 | |
| SBERT-base-nli-stsb-v2Method Category=Out-of-the-box supervised2021.04 | 54.5 | |
| MLMTraining Strategy=Domain adaptation, Protocol=NLI+STS → target task2021.04 | 54.4 | |
| MLMTraining Strategy=Unsupervised learning, Backbone=BERT-base2021.04 | 54.3 | |
| BERT-flowTraining Strategy=Unsupervised learning, Backbone=BERT-base2021.04 | 53.7 | |
| BM25Method Category=Classical Information Retrieval2021.04 | 53.4 | |
| SBERT-base-nli-v2Method Category=Out-of-the-box supervised2021.04 | 53.4 | |
| Avg. GloVeMethod Category=Unsupervised Approaches2021.04 | 51 | |
| Sent2VecMethod Category=Unsupervised Approaches2021.04 | 49 | |
| BERT-base-uncasedMethod Category=Pre-trained (No task tuning)2021.04 | 48.5 |