Term Typing Task on Multi-domain Ontologies
58.1Performance on Events DomainOntoLearner
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| OntoLearnerBackbone LLM=Qwen3-4B-I, Retriever=Qwen3-Embedding-8B2026.07 | 58.1 | 71.2 | 61 | 60.5 | 82.3 | 47.3 | 47.8 | 61.6 | 61.1 | 49 | 33.1 | 50 | |
| OntoLearnerBackbone LLM=Qwen3-8B, Retriever=Qwen3-Embedding-8B2026.07 | 56.2 | 65.6 | 54.1 | 69.5 | 81.9 | 41.8 | 47.4 | 61.7 | 51.1 | 41.2 | 34.7 | 44.4 | |
| OntoLearnerBackbone LLM=Gemma-3-27B-it, Retriever=Qwen3-Embedding-8B2026.07 | 56 | 64.2 | 49.5 | 58.6 | 27.5 | 44.6 | 49.3 | 59 | 62.2 | 32.8 | 30.8 | 46.9 | |
| OntoLearnerBackbone LLM=Qwen3-Next-80B-I, Retriever=Qwen3-Embedding-8B2026.07 | 55.2 | 82.7 | 61.3 | 67.6 | 57.2 | 63.7 | 53.2 | 73.2 | 28.8 | 59.1 | 44.6 | 46 | |
| OntoLearnerBackbone LLM=Mistral-Small-3.2-24B-I, Retriever=Qwen3-Embedding-8B2026.07 | 53.1 | 68.3 | 42.7 | 61.9 | 47.5 | 33 | 42.8 | 59.8 | 38.1 | 25.6 | 23.3 | 44 | |
| OntoLearnerBackbone LLM=Gemma-3-12B-it, Retriever=Qwen3-Embedding-8B2026.07 | 52.4 | 62.3 | 30.8 | 55.9 | 78.7 | 29.3 | 36.9 | 52.6 | 53.1 | 29.7 | 29.3 | 43.1 | |
| OntoLearnerBackbone LLM=Qwen3-0.6B, Retriever=Qwen3-Embedding-8B2026.07 | 50 | 22.2 | 8.5 | 39.5 | 66.7 | 17 | 14.6 | 12.8 | 55.8 | 12.2 | 14.2 | 39.6 | |
| OntoLearnerBackbone LLM=Qwen3-4B-TH, Retriever=Qwen3-Embedding-8B2026.07 | 49.1 | 25 | 7.3 | 36.6 | 56.6 | 16.9 | 13.7 | 14.6 | 37.2 | 11.3 | 16.6 | 29 | |
| OntoLearnerBackbone LLM=Falcon-H1-1.5B-Deep-I, Retriever=Qwen3-Embedding-8B2026.07 | 48.8 | 54.5 | 47.3 | 52.4 | 65.5 | 36 | 43.5 | 53.8 | 49 | 34.8 | 26.5 | 24.7 | |
| OntoLearnerBackbone LLM=Gemma-3-4B-it, Retriever=Qwen3-Embedding-8B2026.07 | 48.5 | 65.7 | 29.3 | 47.5 | 72.1 | 21.1 | 36.9 | 37.7 | 43.3 | 20.8 | 26.3 | 38.8 | |
| OntoLearnerBackbone LLM=Gemma-3-1B-it, Retriever=Qwen3-Embedding-8B2026.07 | 43.2 | 21.4 | 11.9 | 33.4 | 12.1 | 14 | 13.7 | 19.9 | 34 | 9.7 | 13.5 | 22.9 | |
| OntoLearnerBackbone LLM=Qwen3-14B, Retriever=Qwen3-Embedding-8B2026.07 | 40 | 71.8 | 42 | 61.9 | 5 | 44.7 | 49.1 | 70 | 38.3 | 44.9 | 42.3 | 37.7 |