Retrieval on OET-Disease Retrieval SNOMED-14
50MRRHiT
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| HiTDepth threshold (d)=4, Encoder variant=Miniature, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 50 | 35 | 62 | 65 | 11 | |
| OnTDepth threshold (d)=4, Encoder variant=Full, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 47 | 31 | 53 | 65 | 23 | |
| HiTDepth threshold (d)=4, Encoder variant=Full, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 46 | 36 | 49 | 56 | 17 | |
| OnTDepth threshold (d)=4, Encoder variant=Miniature, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 46 | 25 | 60 | 71 | 11 | |
| OnTDepth threshold (d)=2, Encoder variant=Miniature, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 44 | 25 | 56 | 65 | 60 | |
| OnTDepth threshold (d)=2, Encoder variant=Full, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 41 | 29 | 47 | 51 | 67 | |
| SapBERTDepth threshold (d)=22025.11 | 39 | 27 | 42 | 55 | 1,089 | |
| SapBERTDepth threshold (d)=42025.11 | 39 | 27 | 42 | 55 | 968 | |
| SapBERTDepth threshold (d)=02025.11 | 38 | 27 | 40 | 49 | 1,300 | |
| HiTDepth threshold (d)=2, Encoder variant=Miniature, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 36 | 24 | 47 | 53 | 59 | |
| OnTDepth threshold (d)=0, Encoder variant=Full, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 31 | 22 | 38 | 40 | 2,561 | |
| OnTDepth threshold (d)=0, Encoder variant=Miniature, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 30 | 16 | 40 | 51 | 3,443 | |
| SBERTDepth threshold (d)=22025.11 | 28 | 18 | 36 | 38 | 1,282 | |
| SBERTDepth threshold (d)=42025.11 | 28 | 18 | 36 | 38 | 793 | |
| SBERTDepth threshold (d)=02025.11 | 23 | 16 | 29 | 31 | 3,804 | |
| HiTDepth threshold (d)=0, Encoder variant=Miniature, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 20 | 15 | 24 | 24 | 3,057 | |
| HiTDepth threshold (d)=2, Encoder variant=Full, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 20 | 11 | 22 | 27 | 88 | |
| BM25Depth threshold (d)=22025.11 | 14 | 11 | 13 | 15 | 23,499 | |
| BM25Depth threshold (d)=42025.11 | 14 | 11 | 13 | 15 | 21,960 | |
| TF-IDFDepth threshold (d)=22025.11 | 13 | 7 | 16 | 18 | 75,686 | |
| TF-IDFDepth threshold (d)=42025.11 | 13 | 7 | 16 | 18 | 75,651 | |
| TF-IDFDepth threshold (d)=02025.11 | 12 | 7 | 15 | 16 | 82,027 | |
| BM25Depth threshold (d)=02025.11 | 12 | 9 | 11 | 13 | 30,056 | |
| HiTDepth threshold (d)=0, Encoder variant=Full, Encoder=SNOMED-14, Subsumption score s(q, A)=true2025.11 | 11 | 7 | 13 | 15 | 3,855 |