Hypernym discovery on music Gold standard domain-specific (test)
80.6MRRTaxoLLaMA
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| TaxoLLaMAEvaluation Protocol=fine-tuned, Training Data=Target dataset2024.03 | 80.6 | — | — | — | — | — | |
| TaxoLLaMA-benchEvaluation Protocol=fine-tuned, Training Data=Target dataset2024.03 | 78.63 | — | — | — | — | — | |
| HybridLLM pre-training=No2024.03 | 77.24 | — | — | — | — | — | |
| RMMLLM pre-training=No2024.03 | 74.75 | — | — | — | — | — | |
| CRIMLLM pre-training=No2024.03 | 60.93 | — | — | — | — | — | |
| T52024.03 | 53.35 | — | — | — | — | — | |
| TaxoLLaMA-benchEvaluation Protocol=zero-shot, Training Data=WordNet only2024.03 | 44.36 | — | — | — | — | — | |
| TaxoLLaMAEvaluation Protocol=zero-shot, Training Data=WordNet only2024.03 | 42.7 | — | — | — | — | — | |
| CNNEmbedding=Word2018.05 | 27.15 | 17.58 | 0 | 20 | 20 | 16.04 | |
| RCNNEmbedding=Word2018.05 | 21.67 | 13.6 | 0.07 | 13.33 | 14.67 | 13.08 | |
| LSTMEmbedding=Word2018.05 | 20.77 | 14.08 | 0.07 | 13.33 | 16 | 15 | |
| GRUEmbedding=Word2018.05 | 20.33 | 15.2 | 0 | 17.78 | 18.67 | 15.45 | |
| TEAEmbedding=Word2018.05 | 14.32 | 7.11 | 0 | 10.01 | 10.77 | 9.21 | |
| GRUEmbedding=Sense2018.05 | 10.74 | 5.32 | 2 | 4.44 | 5.33 | 4.95 | |
| LSTMEmbedding=Sense2018.05 | 10.21 | 4.39 | 0 | 8.89 | 5.33 | 3.61 | |
| CNNEmbedding=Sense2018.05 | 9.61 | 4.75 | 0 | 6.67 | 6.67 | 4.43 | |
| RCNNEmbedding=Sense2018.05 | 8.56 | 4.73 | 0 | 4.44 | 6.22 | 4.94 | |
| TEAEmbedding=Sense2018.05 | 5.28 | 2.59 | 0 | 2.12 | 3.01 | 2.93 |