# Hypernym discovery on medical Gold standard domain-specific (test) Source: [Hypernym discovery on medical Gold standard domain-specific (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:50:26.043Z Evaluation of Hypernym discovery performance on the test split of the medical Gold standard domain-specific dataset, measured using MAP, MRR, and Precision@K metrics. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Hypernym discovery | | Dataset (including any stated split) | medical Gold standard domain-specific (test) | | Metric | MRR | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [MRR](): Higher is better; unit: PERCENT. - [MAP](): Higher is better; unit: PERCENT. - [Precision@1](): Higher is better; unit: PERCENT. - [Precision@3](): Higher is better; unit: PERCENT. - [Precision@5](): Higher is better; unit: PERCENT. - [Precision@15](): Higher is better; unit: PERCENT. ## Recorded results | Method | MRR | Result date | Report paper | | --- | --- | --- | --- | | TaxoLLaMA | 77.32 | Not recorded | 68fa75ad1e209131cea693ce | | TaxoLLaMA-bench | 73.82 | Not recorded | 68fa75ad1e209131cea693ce | | Hybrid | 64.47 | Not recorded | 68fa75ad1e209131cea693ce | | RMM | 54.89 | Not recorded | 68fa75ad1e209131cea693ce | | CRIM | 54.64 | Not recorded | 68fa75ad1e209131cea693ce | | T5 | 44.73 | Not recorded | 68fa75ad1e209131cea693ce | | TaxoLLaMA | 43.09 | Not recorded | 68fa75ad1e209131cea693ce | | TaxoLLaMA-bench | 42.2 | Not recorded | 68fa75ad1e209131cea693ce | | CNN | 24.52 | Not recorded | 68fa646b1e209131cea0498d | | RCNN | 23.4 | Not recorded | 68fa646b1e209131cea0498d | | GRU | 21.89 | Not recorded | 68fa646b1e209131cea0498d | | LSTM | 21.11 | Not recorded | 68fa646b1e209131cea0498d | | TEA | 16.77 | Not recorded | 68fa646b1e209131cea0498d | | LSTM | 10.22 | Not recorded | 68fa646b1e209131cea0498d | | RCNN | 9.84 | Not recorded | 68fa646b1e209131cea0498d | | GRU | 9.11 | Not recorded | 68fa646b1e209131cea0498d | | CNN | 7.84 | Not recorded | 68fa646b1e209131cea0498d | | TEA | 4.77 | Not recorded | 68fa646b1e209131cea0498d | ### TaxoLLaMA MRR: 77.32. Result ID: 6993f4ed3a6c31484919c9e5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"fine-tuned","Training Data":"Target dataset"}. This record does not assert independent reproduction. ### TaxoLLaMA-bench MRR: 73.82. Result ID: 6993f4ed3a6c31484919c9e6. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"fine-tuned","Training Data":"Target dataset"}. This record does not assert independent reproduction. ### Hybrid MRR: 64.47. Result ID: 6993f4ed3a6c31484919c9e0. [Reporting paper]() Recorded evaluation configuration: {"LLM pre-training":"No"}. This record does not assert independent reproduction. ### RMM MRR: 54.89. Result ID: 6993f4ed3a6c31484919c9e1. [Reporting paper]() Recorded evaluation configuration: {"LLM pre-training":"No"}. This record does not assert independent reproduction. ### CRIM MRR: 54.64. Result ID: 6993f4ed3a6c31484919c9df. [Reporting paper]() Recorded evaluation configuration: {"LLM pre-training":"No"}. This record does not assert independent reproduction. ### T5 MRR: 44.73. Result ID: 6993f4ed3a6c31484919c9e2. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### TaxoLLaMA MRR: 43.09. Result ID: 6993f4ed3a6c31484919c9e3. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"zero-shot","Training Data":"WordNet only"}. This record does not assert independent reproduction. ### TaxoLLaMA-bench MRR: 42.2. Result ID: 6993f4ed3a6c31484919c9e4. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"zero-shot","Training Data":"WordNet only"}. This record does not assert independent reproduction. ### CNN MRR: 24.52. Result ID: 698c3211be3fcfa82d014d24. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Embedding":"Word"}. This record does not assert independent reproduction. ### RCNN MRR: 23.4. Result ID: 698c3211be3fcfa82d014d25. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Embedding":"Word"}. This record does not assert independent reproduction. ### GRU MRR: 21.89. Result ID: 698c3211be3fcfa82d014d22. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Embedding":"Word"}. This record does not assert independent reproduction. ### LSTM MRR: 21.11. Result ID: 698c3211be3fcfa82d014d23. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Embedding":"Word"}. This record does not assert independent reproduction. ### TEA MRR: 16.77. Result ID: 698c3211be3fcfa82d014d21. [Reporting paper]() Recorded evaluation configuration: {"Embedding":"Word"}. This record does not assert independent reproduction. ### LSTM MRR: 10.22. Result ID: 698c3211be3fcfa82d014d28. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Embedding":"Sense"}. This record does not assert independent reproduction. ### RCNN MRR: 9.84. Result ID: 698c3211be3fcfa82d014d2a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Embedding":"Sense"}. This record does not assert independent reproduction. ### GRU MRR: 9.11. Result ID: 698c3211be3fcfa82d014d27. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Embedding":"Sense"}. This record does not assert independent reproduction. ### CNN MRR: 7.84. Result ID: 698c3211be3fcfa82d014d29. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Embedding":"Sense"}. This record does not assert independent reproduction. ### TEA MRR: 4.77. Result ID: 698c3211be3fcfa82d014d26. [Reporting paper]() Recorded evaluation configuration: {"Embedding":"Sense"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.