Complete trial similarity search on Labeled Clinical Trial (test)
64.7Precision@1SECRET
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| SECRETtraining=fine-tuned, batch size=162025.05 | 64.7 | 46.7 | 50.8 | 68.2 | 29.7 | 92.4 | 79.6 | 75.4 | |
| Trial2Vecmode=self-supervised2025.05 | 42.2 | 26.3 | 37.5 | 45.8 | 22.7 | 68.9 | 53.3 | 53.9 | |
| TF-IDFmode=unsupervised2025.05 | 36.3 | 24.4 | 29.8 | 38.8 | 21.7 | 68.7 | 52.2 | 50.1 | |
| BioBERTmode=unsupervised2025.05 | 34.7 | 20.2 | 27.5 | 31.3 | 20.2 | 61.2 | 46.2 | 45 | |
| BM25mode=unsupervised2025.05 | 33.4 | 22.3 | 27.1 | 35 | 18 | 56.7 | 45.4 | 47.1 | |
| Word2Vecmode=unsupervised2025.05 | 29.3 | 18.4 | 26.6 | 32.8 | 19.1 | 57.3 | 43.5 | 43.5 | |
| Bio_ClinicalBERTmode=unsupervised2025.05 | 28 | 16.9 | 26.1 | 31.7 | 20.7 | 64.4 | 46.4 | 43.7 | |
| Longformermode=unsupervised2025.05 | 25.3 | 15.8 | 27.2 | 33.8 | 19.8 | 63.1 | 44.7 | 42.5 | |
| BERTmode=unsupervised2025.05 | 24.1 | 13 | 23.5 | 27.9 | 19.7 | 59.1 | 41.5 | 40 | |
| Clinical-Longformermode=unsupervised2025.05 | 20.6 | 12.3 | 21.1 | 25.2 | 16.8 | 55.3 | 36.9 | 36.9 | |
| IDCMmode=unsupervised2025.05 | 15.6 | 10.2 | 16.7 | 20.6 | 13.2 | 39.1 | 28.6 | 32.4 |