Knowledge Graph Construction on HotpotQA (with Efficiency Metrics)
173Total Triples CountIN-CONTEXT
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| IN-CONTEXTLLM Backbone=Qwen3-30B-A3B2026.05 | 173 | 79.4 | 70 | 82.6 | 93,300,000 | 12,500,000 | 35.8 | |
| KGGENLLM Backbone=Qwen3-30B-A3B2026.05 | 155 | — | 0 | — | 71,700,000 | 11,000,000 | 28.9 | |
| KGGENLLM Backbone=GPT-OSS-120B2026.05 | 128 | — | 0 | — | 87,800,000 | 54,800,000 | 76.8 | |
| OAKLLM Backbone=Qwen3-30B-A3B2026.05 | 127 | 63.4 | 45 | 33.6 | 34,300,000 | 7,700,000 | 16.3 | |
| OAK+MENDLLM Backbone=Qwen3-30B-A3B2026.05 | 127 | 96.8 | 45 | 91.5 | 74,000,000 | 8,300,000 | 26.8 | |
| WIKONTICLLM Backbone=Qwen3-30B-A3B2026.05 | 117 | 77.4 | 45 | — | 139,300,000 | 10,500,000 | 45.3 | |
| OAKLLM Backbone=GPT-OSS-120B2026.05 | 113 | 67.9 | 45 | 35.7 | 33,800,000 | 28,400,000 | 36.8 | |
| OAK+MENDLLM Backbone=GPT-OSS-120B2026.05 | 112 | 98.4 | 45 | 96.8 | 67,700,000 | 52,300,000 | 69.2 | |
| WIKONTICLLM Backbone=GPT-OSS-120B2026.05 | 110 | 99 | 40 | — | 139,500,000 | 52,400,000 | 87.3 | |
| IN-CONTEXTLLM Backbone=GPT-OSS-120B2026.05 | 67 | 97.9 | 8,639 | 97.7 | 98,900,000 | 21,500,000 | 46.2 |