Patient-to-trial matching on TREC 2021 (test)
0.71Precision@1SECRET
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| SECRETtraining_mode=zero-shot2025.05 | 0.71 | 0.158 | 0.682 | 0.292 | 0.627 | 0.641 | 0.666 | 0.744 | |
| BioBERTtraining_mode=zero-shot2025.05 | 0.61 | 0.125 | 0.574 | 0.244 | 0.563 | 0.582 | 0.586 | 0.659 | |
| Trial2Vectraining_mode=zero-shot2025.05 | 0.608 | 0.129 | 0.598 | 0.25 | 0.602 | 0.616 | 0.618 | 0.695 | |
| Bio_ClinicalBERTtraining_mode=zero-shot2025.05 | 0.565 | 0.122 | 0.601 | 0.251 | 0.552 | 0.57 | 0.575 | 0.659 | |
| Longformertraining_mode=zero-shot2025.05 | 0.534 | 0.106 | 0.532 | 0.21 | 0.539 | 0.546 | 0.545 | 0.628 | |
| BM25training_mode=zero-shot2025.05 | 0.527 | 0.112 | 0.53 | 0.218 | 0.493 | 0.504 | 0.514 | 0.623 | |
| Word2Vectraining_mode=zero-shot2025.05 | 0.523 | 0.102 | 0.551 | 0.218 | 0.546 | 0.548 | 0.548 | 0.642 | |
| TF-IDFtraining_mode=zero-shot2025.05 | 0.494 | 0.097 | 0.529 | 0.217 | 0.536 | 0.546 | 0.541 | 0.641 | |
| BERTtraining_mode=zero-shot2025.05 | 0.483 | 0.095 | 0.519 | 0.218 | 0.513 | 0.52 | 0.516 | 0.619 | |
| Clinical-Longformertraining_mode=zero-shot2025.05 | 0.46 | 0.095 | 0.499 | 0.2 | 0.479 | 0.487 | 0.487 | 0.598 | |
| IDCMtraining_mode=zero-shot2025.05 | 0.353 | 0.068 | 0.443 | 0.178 | 0.516 | 0.521 | 0.493 | 0.586 |