Knowledge Graph Construction on MINE benchmark 100 articles
104.2Mean Node CountSoKG
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| SoKGLLM Backbone=Claude-42026.01 | 104.2 | 128.4 | 2.48 | |
| SoKG (w/o 5W1H)LLM Backbone=Claude-42026.01 | 84.2 | 94.5 | 2.25 | |
| SoKGLLM Backbone=Gemini-2.52026.01 | 65.7 | 80.8 | 2.47 | |
| SoKGLLM Backbone=GPT-4o2026.01 | 62.3 | 60.5 | 1.95 | |
| Direct ExtractionLLM Backbone=Gemini-2.52026.01 | 58.4 | 64.1 | 2.2 | |
| SoKG (w/o 5W1H)LLM Backbone=Gemini-2.52026.01 | 58 | 67.8 | 2.34 | |
| SoKGLLM Backbone=GPT-4o-mini2026.01 | 57.9 | 62.2 | 2.16 | |
| KGGenLLM Backbone=Claude-42026.01 | 57.2 | 58.9 | 2.07 | |
| SoKG (w/o 5W1H)LLM Backbone=GPT-4o2026.01 | 51.9 | 49.1 | 1.89 | |
| SoKG (w/o 5W1H)LLM Backbone=GPT-4o-mini2026.01 | 49.2 | 50.5 | 2.06 | |
| Direct ExtractionLLM Backbone=Claude-42026.01 | 46.4 | 40.8 | 1.77 | |
| KGGenLLM Backbone=Gemini-2.52026.01 | 38.1 | 43.2 | 2.23 | |
| SoKGLLM Backbone=Qwen-2.52026.01 | 34.9 | 34.1 | 1.96 | |
| Direct ExtractionLLM Backbone=GPT-4o2026.01 | 33.9 | 27.4 | 1.62 | |
| Direct ExtractionLLM Backbone=GPT-4o-mini2026.01 | 33.5 | 28.1 | 1.69 | |
| KGGenLLM Backbone=GPT-4o2026.01 | 33.2 | 28.9 | 1.74 | |
| KGGenLLM Backbone=Qwen-2.52026.01 | 28.1 | 22.1 | 1.56 | |
| SoKG (w/o 5W1H)LLM Backbone=Qwen-2.52026.01 | 28 | 25.4 | 1.81 | |
| Direct ExtractionLLM Backbone=Qwen-2.52026.01 | 21.7 | 17.3 | 1.6 | |
| GraphRAGLLM Backbone=Qwen-2.52026.01 | 19.8 | 19 | 2 | |
| KGGenLLM Backbone=GPT-4o-mini2026.01 | 19.3 | 16.7 | 1.75 | |
| GraphRAGLLM Backbone=Gemini-2.52026.01 | 15.4 | 17.7 | 2.35 | |
| GraphRAGLLM Backbone=Claude-42026.01 | 14.6 | 16.2 | 2.2 | |
| GraphRAGLLM Backbone=GPT-4o2026.01 | 11.3 | 9.7 | 1.75 | |
| GraphRAGLLM Backbone=GPT-4o-mini2026.01 | 11.2 | 10.2 | 1.84 |