Ontological Generalization on ontological generalisation
0.617Max SCQwen2.5 (Instruct)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Qwen2.5 (Instruct)Condition=optimized, Best Layer=11, Zero-shot=true2026.05 | 0.617 | 86.67 | 86.67 | 93.33 | |
| Qwen2.5 (Instruct)Condition=no-prompt, Best Layer=8, Zero-shot=true2026.05 | 0.54 | 53.33 | 60 | 60 | |
| mpnetCondition=optimized, Best Layer=3, Zero-shot=true2026.05 | 0.465 | 86.67 | 86.67 | 86.67 | |
| mpnetCondition=no-prompt, Best Layer=3, Zero-shot=true2026.05 | 0.449 | 60 | 60 | 60 | |
| Qwen2.5 (Base)Condition=optimized, Best Layer=17, Zero-shot=true2026.05 | 0.294 | 73.33 | 73.33 | 80 | |
| Qwen2.5 (Base)Condition=no-prompt, Best Layer=7, Zero-shot=true2026.05 | 0.269 | 53.33 | 73.33 | 66.67 | |
| Gemma-2 (Base)Condition=optimized, Best Layer=5, Zero-shot=true2026.05 | 0.172 | 53.33 | 60 | 60 | |
| Gemma-2 (Instruct)Condition=optimized, Best Layer=14, Zero-shot=true2026.05 | 0.148 | 93.33 | 93.33 | 93.33 | |
| Gemma-2 (Instruct)Condition=no-prompt, Best Layer=0, Zero-shot=true2026.05 | 0.122 | 53.33 | 60 | 80 | |
| Gemma-2 (Base)Condition=no-prompt, Best Layer=2, Zero-shot=true2026.05 | 0.086 | 66.67 | 66.67 | 86.67 |