Hypernym Discovery on SemEval Task 9 English general-purpose subtask 2018
0.5439MRRTaxoLLaMA
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| TaxoLLaMAEvaluation Protocol=fine-tuned, Training Data=Target dataset2024.03 | 0.5439 | — | — | — | — | — | |
| TaxoLLaMA-benchEvaluation Protocol=fine-tuned, Training Data=Target dataset2024.03 | 0.5159 | — | — | — | — | — | |
| T52024.03 | 0.4522 | — | — | — | — | — | |
| RMMLLM pre-training=No2024.03 | 0.3907 | — | — | — | — | — | |
| TaxoLLaMAEvaluation Protocol=zero-shot, Training Data=WordNet only2024.03 | 0.3805 | — | — | — | — | — | |
| TaxoLLaMA-benchEvaluation Protocol=zero-shot, Training Data=WordNet only2024.03 | 0.3766 | — | — | — | — | — | |
| CRIMLLM pre-training=No2024.03 | 0.361 | — | — | — | — | — | |
| HybridLLM pre-training=No2024.03 | 0.3407 | — | — | — | — | — | |
| GRUEmbedding=Word2018.05 | 0.1622 | 0.0813 | 0.08 | 0.08 | 0.0667 | 0.0694 | |
| CNNEmbedding=Word2018.05 | 0.1333 | 0.0732 | 0.08 | 0.09 | 0.078 | 0.0694 | |
| RCNNEmbedding=Word2018.05 | 0.1283 | 0.0874 | 0.06 | 0.0967 | 0.0887 | 0.0915 | |
| TEAEmbedding=Word2018.05 | 0.1113 | 0.061 | 0.04 | 0.06 | 0.054 | 0.0514 | |
| CNNEmbedding=Sense2018.05 | 0.1092 | 0.0641 | 0.02 | 0.0501 | 0.0567 | 0.0629 | |
| LSTMEmbedding=Sense2018.05 | 0.0997 | 0.0562 | 0.04 | 0.0435 | 0.0501 | 0.0683 | |
| GRUEmbedding=Sense2018.05 | 0.0944 | 0.0542 | 0 | 0.0444 | 0.0489 | 0.0583 | |
| RCNNEmbedding=Sense2018.05 | 0.0924 | 0.0579 | 0 | 0.0471 | 0.0529 | 0.0643 | |
| TEAEmbedding=Sense2018.05 | 0.0871 | 0.0442 | 0 | 0.0404 | 0.0419 | 0.0531 | |
| LSTMEmbedding=Word2018.05 | 0.0752 | 0.0395 | 0.04 | 0.0433 | 0.0397 | 0.0397 |