Partial trial similarity search (Query-to-trial matching) on Labeled (test)
0.548Precision@1SECRET
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| SECRETlearning_type=fine-tuned, batch_size=highest validation score configuration2025.05 | 0.548 | 0.39 | 0.465 | 0.623 | 0.289 | 0.902 | 0.745 | 0.696 | |
| Trial2Veclearning_type=self-supervised2025.05 | 0.456 | 0.322 | 0.37 | 0.482 | 0.228 | 0.717 | 0.592 | 0.579 | |
| BM25learning_type=unsupervised2025.05 | 0.363 | 0.248 | 0.298 | 0.39 | 0.199 | 0.627 | 0.493 | 0.49 | |
| TF-IDFlearning_type=unsupervised2025.05 | 0.359 | 0.252 | 0.32 | 0.41 | 0.214 | 0.664 | 0.517 | 0.505 | |
| Word2Veclearning_type=self-supervised2025.05 | 0.308 | 0.203 | 0.237 | 0.318 | 0.19 | 0.595 | 0.413 | 0.416 | |
| IDCM2025.05 | 0.306 | 0.213 | 0.273 | 0.369 | 0.18 | 0.584 | 0.452 | 0.462 | |
| BioBERTlearning_type=self-supervised2025.05 | 0.288 | 0.191 | 0.241 | 0.318 | 0.192 | 0.601 | 0.447 | 0.442 | |
| Bio_ClinicalBERTlearning_type=self-supervised2025.05 | 0.257 | 0.172 | 0.203 | 0.276 | 0.18 | 0.578 | 0.413 | 0.413 | |
| Clinical-Longformerlearning_type=self-supervised2025.05 | 0.238 | 0.16 | 0.221 | 0.303 | 0.181 | 0.573 | 0.413 | 0.412 | |
| Longformerlearning_type=self-supervised2025.05 | 0.235 | 0.163 | 0.199 | 0.264 | 0.156 | 0.49 | 0.364 | 0.385 | |
| BERTlearning_type=self-supervised2025.05 | 0.233 | 0.137 | 0.204 | 0.244 | 0.179 | 0.565 | 0.385 | 0.385 |