Knowledge Graph Completion on AnimalKB TextBench 1.0 (test)
44.2MRRgemini-1.5-pro
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| gemini-1.5-proCategory=LLM-based, Task-specific training=In-prompt/Few-shot2025.12 | 44.2 | 28.8 | 52.3 | 81.1 | |
| gpt-4oCategory=LLM-based, Task-specific training=In-prompt/Few-shot, Version=08062025.12 | 42.9 | 34.3 | 46 | 60.8 | |
| SimKGCCategory=Text-based, Task-specific training=Trained2025.12 | 38.6 | 32.4 | 40.7 | 50.2 | |
| StARCategory=Text-based, Task-specific training=Trained2025.12 | 30.9 | 23.6 | 33.7 | 44.6 | |
| KG-BertCategory=Text-based, Task-specific training=Trained2025.12 | 21.1 | 12.3 | 23.9 | 38.2 | |
| RotatECategory=Embedding-based, Task-specific training=Trained2025.12 | 19.6 | 15.8 | 21.4 | 26.5 | |
| TransECategory=Embedding-based, Task-specific training=Trained2025.12 | 18.1 | 11.5 | 22 | 29.8 | |
| ComplExCategory=Embedding-based, Task-specific training=Trained2025.12 | 12 | 10.7 | 12.2 | 14.7 | |
| DistMultCategory=Embedding-based, Task-specific training=Trained2025.12 | 11 | 9.2 | 11.3 | 14.1 |