Controllable Abductive Reasoning on FB15k-237
65.5JaccardCtrlHGen
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| CtrlHGenCondition=pattern2025.05 | 65.5 | 73 | 83.9 | 98.9 | 82.3 | |
| CtrlHGenCondition=relation-number2025.05 | 65.1 | 72.7 | 83.5 | 99.4 | 82.4 | |
| CtrlHGenCondition=specific-entity2025.05 | 64.3 | 71.1 | 82.4 | 98.9 | 71.2 | |
| CtrlHGen2025.05 | 64.3 | 71.9 | 83 | 96.6 | 73.3 | |
| CtrlHGenCondition=specific-relation2025.05 | 63.3 | 71.4 | 82.6 | 99.5 | 64.8 | |
| CtrlHGenCondition=entity-number2025.05 | 63.1 | 71.5 | 82.7 | 86.3 | 65.7 | |
| AbductiveKGRCondition=uncondition2025.05 | 61.4 | 69.3 | 82.3 | — | 61.4 | |
| GPT5external_knowledge=2-hop subgraph, thinking_mode=true2025.05 | 18.7 | 21.9 | 37.3 | 92.8 | 32.9 | |
| DeepSeek-V3external_knowledge=RAG, thinking_mode=false, temperature=0.02025.05 | 5.3 | 6.7 | 10.4 | 76.6 | 41.8 | |
| Kimi K2external_knowledge=2-hop subgraph, thinking_mode=false, temperature=0.02025.05 | 3.1 | 4.7 | 8.5 | 71.6 | 42.4 | |
| Grok-3external_knowledge=2-hop subgraph, thinking_mode=false, temperature=0.02025.05 | 2.5 | 3.7 | 6.9 | 75.6 | 43.5 | |
| GPT-4oexternal_knowledge=2-hop subgraph, thinking_mode=false, temperature=0.02025.05 | 2.4 | 3.1 | 5.3 | 77.5 | 37.9 | |
| DeepSeek-V3external_knowledge=2-hop subgraph, thinking_mode=false, temperature=0.02025.05 | 2.1 | 2.8 | 6.3 | 73.9 | 41.8 |