Triple Validity Evaluation on Knowledge Graph (KG) Triple Validity (full)
68.7Validity Score (Qwen3-32B)GraphMERT
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| GraphMERTModel size=80M, #triples=138,2012025.10 | 68.7 | 18.3 | 10.8 | 2.2 | 81.3 | 18.5 | 0.2 | 10 | |
| Grok 4 FastModel size=1.7T, #triples=100,0002025.10 | 56.9 | 21.9 | 21.2 | 0.1 | 68.8 | 30.9 | 0.3 | 10 | |
| UMLS Seed KGModel size=N/A, #triples=28,5332025.10 | 53.4 | 10 | 34.7 | 1.9 | 82.5 | 16.5 | 1.1 | 10 | |
| Qwen3-32B (baseline)Model size=32B, #triples=515,4602025.10 | 43 | 24.1 | 31.4 | 1.5 | 66 | 33.6 | 0.3 | 10 | |
| Qwen3-14BModel size=14B, #triples=100,0002025.10 | 31.8 | 21.9 | 46.2 | 0.1 | 53.4 | 45.7 | 0.9 | 10 |