Retrieval on EVAL-100 Retrieval SNOMED-25
24MRRHiT
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| HiTDepth threshold (d)=4, Encoder variant=Full, Encoder=SNOMED-25, Subsumption score s(q, A)=true2025.11 | 24 | 16 | 25 | 33 | 392 | |
| HiTDepth threshold (d)=2, Encoder variant=Full, Encoder=SNOMED-25, Subsumption score s(q, A)=true2025.11 | 22 | 15 | 22 | 30 | 722 | |
| OnTDepth threshold (d)=4, Encoder variant=Miniature, Encoder=SNOMED-25, Subsumption score s(q, A)=true2025.11 | 20 | 13 | 22 | 26 | 303 | |
| OnTDepth threshold (d)=2, Encoder variant=Miniature, Encoder=SNOMED-25, Subsumption score s(q, A)=true2025.11 | 18 | 12 | 19 | 22 | 577 | |
| OnTDepth threshold (d)=4, Encoder variant=Full, Encoder=SNOMED-25, Subsumption score s(q, A)=true2025.11 | 18 | 6 | 21 | 29 | 317 | |
| OnTDepth threshold (d)=2, Encoder variant=Full, Encoder=SNOMED-25, Subsumption score s(q, A)=true2025.11 | 16 | 6 | 20 | 26 | 646 | |
| HiTDepth threshold (d)=4, Encoder variant=Miniature, Encoder=SNOMED-25, Subsumption score s(q, A)=true2025.11 | 16 | 11 | 14 | 20 | 733 | |
| SapBERTDepth threshold (d)=22025.11 | 15 | 9 | 15 | 20 | 19,456 | |
| SapBERTDepth threshold (d)=42025.11 | 15 | 9 | 15 | 20 | 14,997 | |
| SapBERTDepth threshold (d)=02025.11 | 14 | 9 | 14 | 20 | 26,942 | |
| HiTDepth threshold (d)=0, Encoder variant=Full, Encoder=SNOMED-25, Subsumption score s(q, A)=true2025.11 | 14 | 9 | 15 | 17 | 2,647 | |
| OnTDepth threshold (d)=0, Encoder variant=Miniature, Encoder=SNOMED-25, Subsumption score s(q, A)=true2025.11 | 14 | 10 | 15 | 17 | 2,494 | |
| OnTDepth threshold (d)=0, Encoder variant=Full, Encoder=SNOMED-25, Subsumption score s(q, A)=true2025.11 | 13 | 6 | 16 | 19 | 2,179 | |
| SBERTDepth threshold (d)=22025.11 | 12 | 5 | 15 | 17 | 11,994 | |
| SBERTDepth threshold (d)=42025.11 | 12 | 5 | 15 | 17 | 10,699 | |
| SBERTDepth threshold (d)=02025.11 | 11 | 5 | 14 | 16 | 20,127 | |
| HiTDepth threshold (d)=2, Encoder variant=Miniature, Encoder=SNOMED-25, Subsumption score s(q, A)=true2025.11 | 11 | 8 | 10 | 13 | 1,163 | |
| BM25Depth threshold (d)=22025.11 | 7 | 5 | 7 | 8 | 75,377 | |
| BM25Depth threshold (d)=42025.11 | 7 | 5 | 7 | 8 | 64,054 | |
| BM25Depth threshold (d)=02025.11 | 6 | 5 | 6 | 7 | 101,885 | |
| HiTDepth threshold (d)=0, Encoder variant=Miniature, Encoder=SNOMED-25, Subsumption score s(q, A)=true2025.11 | 6 | 5 | 5 | 6 | 3,773 | |
| TF-IDFDepth threshold (d)=42025.11 | 5 | 2 | 4 | 6 | 244,290 | |
| TF-IDFDepth threshold (d)=02025.11 | 4 | 2 | 3 | 4 | 251,820 | |
| TF-IDFDepth threshold (d)=22025.11 | 4 | 2 | 4 | 5 | 244,291 |