Retrieval on OET-CPP Retrieval SNOMED-14
54MRRHiT
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| HiTDepth threshold (d)=4, Encoder variant=Full, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 54 | 41 | 62 | 70 | 11 | |
| HiTDepth threshold (d)=4, Encoder variant=Miniature, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 49 | 33 | 59 | 66 | 12 | |
| OnTDepth threshold (d)=4, Encoder variant=Full, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 47 | 32 | 54 | 63 | 15 | |
| OnTDepth threshold (d)=4, Encoder variant=Miniature, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 42 | 26 | 49 | 59 | 14 | |
| OnTDepth threshold (d)=2, Encoder variant=Full, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 39 | 27 | 43 | 49 | 51 | |
| HiTDepth threshold (d)=2, Encoder variant=Miniature, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 38 | 25 | 45 | 52 | 52 | |
| OnTDepth threshold (d)=2, Encoder variant=Miniature, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 38 | 24 | 46 | 54 | 46 | |
| HiTDepth threshold (d)=2, Encoder variant=Full, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 33 | 19 | 41 | 50 | 55 | |
| SapBERTDepth threshold (d)=22025.11 | 26 | 18 | 29 | 36 | 3,552 | |
| SapBERTDepth threshold (d)=42025.11 | 26 | 18 | 29 | 36 | 2,898 | |
| SapBERTDepth threshold (d)=02025.11 | 25 | 17 | 28 | 34 | 6,667 | |
| OnTDepth threshold (d)=0, Encoder variant=Miniature, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 25 | 14 | 29 | 38 | 1,339 | |
| OnTDepth threshold (d)=0, Encoder variant=Full, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 25 | 17 | 28 | 31 | 1,170 | |
| SBERTDepth threshold (d)=22025.11 | 19 | 11 | 23 | 28 | 3,923 | |
| SBERTDepth threshold (d)=42025.11 | 19 | 11 | 23 | 28 | 3,129 | |
| SBERTDepth threshold (d)=02025.11 | 17 | 10 | 20 | 24 | 12,683 | |
| HiTDepth threshold (d)=0, Encoder variant=Miniature, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 17 | 10 | 18 | 22 | 1,292 | |
| BM25Depth threshold (d)=42025.11 | 12 | 10 | 13 | 13 | 41,353 | |
| HiTDepth threshold (d)=0, Encoder variant=Full, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 11 | 6 | 11 | 14 | 1,827 | |
| BM25Depth threshold (d)=22025.11 | 11 | 9 | 12 | 13 | 42,459 | |
| BM25Depth threshold (d)=02025.11 | 10 | 8 | 11 | 11 | 51,081 | |
| TF-IDFDepth threshold (d)=22025.11 | 10 | 7 | 12 | 13 | 105,832 | |
| TF-IDFDepth threshold (d)=42025.11 | 10 | 7 | 12 | 13 | 105,820 | |
| TF-IDFDepth threshold (d)=02025.11 | 9 | 7 | 10 | 11 | 107,927 |