Non-Taxonomic Relation Extraction Task on Multi-domain Ontologies
25.9Education PerformanceOntoLearner
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| OntoLearnerBackbone LLM=Qwen3-14B, Retriever=Qwen3-Embedding-8B2026.07 | 25.9 | 42.9 | 22.6 | 40 | 12.2 | 15.4 | 9 | 12.2 | 13.1 | 5.4 | 15.4 | 13.8 | |
| OntoLearnerBackbone LLM=Gemma-3-12B-it, Retriever=Qwen3-Embedding-8B2026.07 | 17.8 | 26.7 | 23.9 | 30 | 10.3 | 13.2 | 6.9 | 11.5 | 17.2 | 4.4 | 15.4 | 8.8 | |
| OntoLearnerBackbone LLM=Qwen3-4B-I, Retriever=Qwen3-Embedding-8B2026.07 | 14.6 | 26.7 | 34.5 | 40 | 10.5 | 13.8 | 7.1 | 11 | 17.1 | 6.6 | 58.8 | 9.9 | |
| OntoLearnerBackbone LLM=Gemma-3-27B-it, Retriever=Qwen3-Embedding-8B2026.07 | 12.7 | 33.3 | 30.1 | 40 | 9.4 | 13.6 | 5.8 | 8.7 | 14.6 | 4.1 | 50 | 12.2 | |
| OntoLearnerBackbone LLM=Qwen3-8B, Retriever=Qwen3-Embedding-8B2026.07 | 11.6 | 40 | 10.8 | 40 | 7 | 25.5 | 6.7 | 11.8 | 23 | 6.8 | 0 | 13.8 | |
| OntoLearnerBackbone LLM=Gemma-3-1B-it, Retriever=Qwen3-Embedding-8B2026.07 | 9.8 | 46.2 | 23.6 | 20 | 6.1 | 20.9 | 2.9 | 6.8 | 31.3 | 4.6 | 50 | 4.3 | |
| OntoLearnerBackbone LLM=Mistral-Small-3.2-24B-I, Retriever=Qwen3-Embedding-8B2026.07 | 9.2 | 46.2 | 31.5 | 30 | 10.1 | 14.3 | 7.5 | 8.5 | 15.9 | 4.3 | 73.7 | 6.3 | |
| OntoLearnerBackbone LLM=Qwen3-Next-80B-I, Retriever=Qwen3-Embedding-8B2026.07 | 8.1 | 37.5 | 36.3 | 60 | 11.6 | 13 | 9.5 | 9 | 20.8 | 5.2 | 90.9 | 9.9 | |
| OntoLearnerBackbone LLM=Qwen3-4B-TH, Retriever=Qwen3-Embedding-8B2026.07 | 7.4 | 26.7 | 13.9 | 20 | 4.6 | 10.9 | 2.9 | 9.2 | 17.3 | 2.3 | 85.7 | 3.2 | |
| OntoLearnerBackbone LLM=Qwen3-0.6B, Retriever=Qwen3-Embedding-8B2026.07 | 7 | 0 | 22.3 | 20 | 6.1 | 12.4 | 3.1 | 7.7 | 19.3 | 3 | 85.7 | 4.3 | |
| OntoLearnerBackbone LLM=Gemma-3-4B-it, Retriever=Qwen3-Embedding-8B2026.07 | 6.9 | 54.5 | 21.6 | 20 | 5.5 | 16.5 | 3.7 | 6 | 19.6 | 3.2 | 66.7 | 4.1 | |
| OntoLearnerBackbone LLM=Falcon-H1-1.5B-Deep-I, Retriever=Qwen3-Embedding-8B2026.07 | 4.5 | 0 | 14 | 30 | 3.1 | 13.6 | 2.4 | 7.4 | 26.1 | 5.1 | 95.7 | 3.5 |