Triple Classification on UMLS
94.55AccuracyGMT
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| GMTType=Ours2025.10 | 94.55 | 91.86 | 95.74 | 93.76 | |
| KoPAType=LLM-based2025.10 | 92.58 | 90.85 | 94.7 | 92.7 | |
| LMKEBackbone=BERT-base2022.06 | 92.4 | — | — | — | |
| SATType=LLM-based2025.10 | 92.24 | 91.05 | 93.99 | 93.17 | |
| RotatEType=Emb-based2025.10 | 92.05 | 90.17 | 94.41 | 92.23 | |
| ComplExType=Emb-based2025.10 | 90.77 | 89.92 | 91.83 | 90.87 | |
| KG-BERT2022.06 | 89.7 | — | — | — | |
| DistMult2022.06 | 86.8 | — | — | — | |
| DistMultType=Emb-based2025.10 | 86.38 | 87.06 | 86.53 | 86.79 | |
| KG-AlpacaType=LLM-based2025.10 | 86.01 | 94.91 | 76.1 | 84.46 | |
| KG-LLaMAType=LLM-based2025.10 | 85.77 | 87.84 | 83.05 | 85.38 | |
| TransEType=Emb-based2025.10 | 84.49 | 86.53 | 81.69 | 84.04 | |
| TransR2022.06 | 81.9 | — | — | — | |
| TransH2022.06 | 79.2 | — | — | — | |
| TransE2022.06 | 78.1 | — | — | — | |
| GPT-3.5Type=LLM-based, Setting=zero-shot2025.10 | 67.58 | 88.04 | 40.71 | 55.67 | |
| ICLType=LLM-based, Setting=8-shot2025.10 | 55.52 | 55.85 | 52.65 | 54.21 | |
| AlpacaType=LLM-based, Setting=zero-shot2025.10 | 52.64 | 51.55 | 87.69 | 64.91 |