Hypernym discovery on medical Gold standard domain-specific (test)
77.32MRRTaxoLLaMA
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| TaxoLLaMAEvaluation Protocol=fine-tuned, Training Data=Target dataset2024.03 | 77.32 | — | — | — | — | — | |
| TaxoLLaMA-benchEvaluation Protocol=fine-tuned, Training Data=Target dataset2024.03 | 73.82 | — | — | — | — | — | |
| HybridLLM pre-training=No2024.03 | 64.47 | — | — | — | — | — | |
| RMMLLM pre-training=No2024.03 | 54.89 | — | — | — | — | — | |
| CRIMLLM pre-training=No2024.03 | 54.64 | — | — | — | — | — | |
| T52024.03 | 44.73 | — | — | — | — | — | |
| TaxoLLaMAEvaluation Protocol=zero-shot, Training Data=WordNet only2024.03 | 43.09 | — | — | — | — | — | |
| TaxoLLaMA-benchEvaluation Protocol=zero-shot, Training Data=WordNet only2024.03 | 42.2 | — | — | — | — | — | |
| CNNEmbedding=Word2018.05 | 24.52 | 18.31 | 0 | 15.56 | 20.44 | 20 | |
| RCNNEmbedding=Word2018.05 | 23.4 | 16.78 | 0 | 13.33 | 13 | 14.5 | |
| GRUEmbedding=Word2018.05 | 21.89 | 13.27 | 0 | 13.33 | 14.89 | 14.06 | |
| LSTMEmbedding=Word2018.05 | 21.11 | 11.49 | 0 | 17.78 | 12.22 | 11.83 | |
| TEAEmbedding=Word2018.05 | 16.77 | 8.91 | 0 | 8.79 | 9.41 | 9.39 | |
| LSTMEmbedding=Sense2018.05 | 10.22 | 5.1 | 0 | 6.67 | 6.12 | 6.94 | |
| RCNNEmbedding=Sense2018.05 | 9.84 | 4.63 | 0 | 6.67 | 6.89 | 6.43 | |
| GRUEmbedding=Sense2018.05 | 9.11 | 4.88 | 0 | 6.67 | 6.42 | 6.91 | |
| CNNEmbedding=Sense2018.05 | 7.84 | 4.15 | 0 | 4.44 | 6.09 | 6.42 | |
| TEAEmbedding=Sense2018.05 | 4.77 | 2.01 | 0 | 2.91 | 2.77 | 3.21 |