# Hypernym discovery on music Gold standard domain-specific (test) Source: [Hypernym discovery on music Gold standard domain-specific (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:50:26.058Z Evaluation of Hypernym discovery performance on the test split of the music Gold standard domain-specific dataset, measured using MAP, MRR, and Precision@K metrics. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Hypernym discovery | | Dataset (including any stated split) | music Gold standard domain-specific (test) | | Metric | MRR | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [MRR](): Higher is better; unit: PERCENT. - [MAP](): Higher is better; unit: PERCENT. - [P@1](): Higher is better; unit: PERCENT. - [P@3](): Higher is better; unit: PERCENT. - [P@5](): Higher is better; unit: PERCENT. - [P@15](): Higher is better; unit: PERCENT. ## Recorded results | Method | MRR | Result date | Report paper | | --- | --- | --- | --- | | TaxoLLaMA | 80.6 | Not recorded | 68fa75ad1e209131cea693ce | | TaxoLLaMA-bench | 78.63 | Not recorded | 68fa75ad1e209131cea693ce | | Hybrid | 77.24 | Not recorded | 68fa75ad1e209131cea693ce | | RMM | 74.75 | Not recorded | 68fa75ad1e209131cea693ce | | CRIM | 60.93 | Not recorded | 68fa75ad1e209131cea693ce | | T5 | 53.35 | Not recorded | 68fa75ad1e209131cea693ce | | TaxoLLaMA-bench | 44.36 | Not recorded | 68fa75ad1e209131cea693ce | | TaxoLLaMA | 42.7 | Not recorded | 68fa75ad1e209131cea693ce | | CNN | 27.15 | Not recorded | 68fa646b1e209131cea0498d | | RCNN | 21.67 | Not recorded | 68fa646b1e209131cea0498d | | LSTM | 20.77 | Not recorded | 68fa646b1e209131cea0498d | | GRU | 20.33 | Not recorded | 68fa646b1e209131cea0498d | | TEA | 14.32 | Not recorded | 68fa646b1e209131cea0498d | | GRU | 10.74 | Not recorded | 68fa646b1e209131cea0498d | | LSTM | 10.21 | Not recorded | 68fa646b1e209131cea0498d | | CNN | 9.61 | Not recorded | 68fa646b1e209131cea0498d | | RCNN | 8.56 | Not recorded | 68fa646b1e209131cea0498d | | TEA | 5.28 | Not recorded | 68fa646b1e209131cea0498d | ### TaxoLLaMA MRR: 80.6. Result ID: 6993f4ed3a6c31484919c9ed. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"fine-tuned","Training Data":"Target dataset"}. This record does not assert independent reproduction. ### TaxoLLaMA-bench MRR: 78.63. Result ID: 6993f4ed3a6c31484919c9ee. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"fine-tuned","Training Data":"Target dataset"}. This record does not assert independent reproduction. ### Hybrid MRR: 77.24. Result ID: 6993f4ed3a6c31484919c9e8. [Reporting paper]() Recorded evaluation configuration: {"LLM pre-training":"No"}. This record does not assert independent reproduction. ### RMM MRR: 74.75. Result ID: 6993f4ed3a6c31484919c9e9. [Reporting paper]() Recorded evaluation configuration: {"LLM pre-training":"No"}. This record does not assert independent reproduction. ### CRIM MRR: 60.93. Result ID: 6993f4ed3a6c31484919c9e7. [Reporting paper]() Recorded evaluation configuration: {"LLM pre-training":"No"}. This record does not assert independent reproduction. ### T5 MRR: 53.35. Result ID: 6993f4ed3a6c31484919c9ea. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### TaxoLLaMA-bench MRR: 44.36. Result ID: 6993f4ed3a6c31484919c9ec. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"zero-shot","Training Data":"WordNet only"}. This record does not assert independent reproduction. ### TaxoLLaMA MRR: 42.7. Result ID: 6993f4ed3a6c31484919c9eb. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Evaluation Protocol":"zero-shot","Training Data":"WordNet only"}. This record does not assert independent reproduction. ### CNN MRR: 27.15. Result ID: 698c3211be3fcfa82d014d2e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Embedding":"Word"}. This record does not assert independent reproduction. ### RCNN MRR: 21.67. Result ID: 698c3211be3fcfa82d014d2f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Embedding":"Word"}. This record does not assert independent reproduction. ### LSTM MRR: 20.77. Result ID: 698c3211be3fcfa82d014d2d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Embedding":"Word"}. This record does not assert independent reproduction. ### GRU MRR: 20.33. Result ID: 698c3211be3fcfa82d014d2c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Embedding":"Word"}. This record does not assert independent reproduction. ### TEA MRR: 14.32. Result ID: 698c3211be3fcfa82d014d2b. [Reporting paper]() Recorded evaluation configuration: {"Embedding":"Word"}. This record does not assert independent reproduction. ### GRU MRR: 10.74. Result ID: 698c3211be3fcfa82d014d31. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Embedding":"Sense"}. This record does not assert independent reproduction. ### LSTM MRR: 10.21. Result ID: 698c3211be3fcfa82d014d32. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Embedding":"Sense"}. This record does not assert independent reproduction. ### CNN MRR: 9.61. Result ID: 698c3211be3fcfa82d014d33. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Embedding":"Sense"}. This record does not assert independent reproduction. ### RCNN MRR: 8.56. Result ID: 698c3211be3fcfa82d014d34. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Embedding":"Sense"}. This record does not assert independent reproduction. ### TEA MRR: 5.28. Result ID: 698c3211be3fcfa82d014d30. [Reporting paper]() Recorded evaluation configuration: {"Embedding":"Sense"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.