Scientific Document Retrieval on SciDocs (dev)
90.4CiteSBERT-supervised
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SBERT-supervisedMethod Category=In-domain supervised2021.04 | 90.4 | 91.2 | 86.2 | 83.6 | 87.9 | |
| TSDAETraining Strategy=Domain adaptation, Protocol=target task → NLI+STS2021.04 | 75.6 | 78.6 | 78.1 | 78.2 | 77.6 | |
| MLMTraining Strategy=Domain adaptation, Protocol=target task → NLI+STS2021.04 | 74.7 | 78.2 | 77 | 77.6 | 76.9 | |
| TSDAETraining Strategy=Unsupervised learning2021.04 | 71.4 | 73.9 | 75 | 75.6 | 74 | |
| MLMTraining Strategy=Unsupervised learning2021.04 | 71.2 | 75.8 | 75.1 | 76.2 | 74.6 | |
| TSDAETraining Strategy=Domain adaptation, Protocol=NLI+STS → target task2021.04 | 69.9 | 73.8 | 75 | 75.7 | 73.6 | |
| MLMTraining Strategy=Domain adaptation, Protocol=NLI+STS → target task2021.04 | 67.1 | 71.8 | 72.6 | 72.9 | 71.1 | |
| USE-largeMethod Category=Out-of-the-box supervised2021.04 | 67.1 | 69.5 | 71.4 | 72.6 | 70.2 | |
| SBERT-base-nli-v2Method Category=Out-of-the-box supervised2021.04 | 66.8 | 70 | 70.7 | 72.8 | 70.1 | |
| CTTraining Strategy=Domain adaptation, Protocol=target task → NLI+STS2021.04 | 66.5 | 69.6 | 70.6 | 72.2 | 69.7 | |
| SBERT-base-nli-stsb-v2Method Category=Out-of-the-box supervised2021.04 | 66.2 | 69.2 | 69.9 | 72.3 | 69.4 | |
| SimCSETraining Strategy=Domain adaptation, Protocol=target task → NLI+STS2021.04 | 65.5 | 68.5 | 70 | 71.4 | 68.9 | |
| CTTraining Strategy=Unsupervised learning2021.04 | 63.4 | 67.1 | 70.1 | 69.7 | 67.6 | |
| SimCSETraining Strategy=Unsupervised learning2021.04 | 62.5 | 65.1 | 67.7 | 67.6 | 65.7 | |
| CTTraining Strategy=Domain adaptation, Protocol=NLI+STS → target task2021.04 | 62.3 | 66.2 | 68.5 | 68.9 | 66.5 | |
| BERT-flowTraining Strategy=Domain adaptation, Protocol=NLI+STS → target task2021.04 | 62.2 | 64.8 | 68.1 | 68 | 65.8 | |
| SimCSETraining Strategy=Domain adaptation, Protocol=NLI+STS → target task2021.04 | 61.8 | 63.7 | 67.01 | 66.7 | 64.8 | |
| Sent2VecMethod Category=Unsupervised2021.04 | 61.6 | 66 | 66.1 | 66.7 | 65.1 | |
| BERT-flowTraining Strategy=Unsupervised learning2021.04 | 61.3 | 62.8 | 66.7 | 67.1 | 64.5 | |
| BERT-base-uncasedMethod Category=Unsupervised2021.04 | 59.4 | 65.1 | 65.4 | 68.6 | 64.6 | |
| BM25Method Category=Classical IR2021.04 | 58.9 | 61.3 | 67.3 | 66.9 | 63.6 | |
| Avg. GloVeMethod Category=Unsupervised2021.04 | 58.8 | 60.6 | 64.2 | 65.4 | 62.2 |