Knowledge Graph Extraction on MINE benchmark 1.0 (100 articles) (test)
0.187NFIKGGen
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| KGGenLLM Backbone=Qwen-2.52026.01 | 0.187 | 2,375 | |
| Direct ExtractionLLM Backbone=GPT-4o2026.01 | 0.172 | 2,941 | |
| Direct ExtractionLLM Backbone=Qwen-2.52026.01 | 0.162 | 1,955 | |
| Direct ExtractionLLM Backbone=GPT-4o-mini2026.01 | 0.145 | 3,100 | |
| Direct ExtractionLLM Backbone=Claude-42026.01 | 0.127 | 4,417 | |
| KGGenLLM Backbone=GPT-4o2026.01 | 0.112 | 3,089 | |
| SoKG (w/o 5W1H)LLM Backbone=Qwen-2.52026.01 | 0.106 | 2,871 | |
| SoKG (w/o 5W1H)LLM Backbone=GPT-4o2026.01 | 0.092 | 5,345 | |
| KGGenLLM Backbone=GPT-4o-mini2026.01 | 0.091 | 1,942 | |
| SoKG (Ours)LLM Backbone=GPT-4o2026.01 | 0.086 | 6,627 | |
| GraphRAGLLM Backbone=Qwen-2.52026.01 | 0.084 | 1,981 | |
| GraphRAGLLM Backbone=GPT-4o2026.01 | 0.083 | 1,009 | |
| SoKG (Ours)LLM Backbone=Qwen-2.52026.01 | 0.078 | 3,958 | |
| GraphRAGLLM Backbone=Claude-42026.01 | 0.067 | 1,590 | |
| SoKG (w/o 5W1H)LLM Backbone=GPT-4o-mini2026.01 | 0.059 | 5,646 | |
| SoKG (w/o 5W1H)LLM Backbone=Claude-42026.01 | 0.056 | 10,511 | |
| KGGenLLM Backbone=Claude-42026.01 | 0.052 | 6,391 | |
| SoKG (Ours)LLM Backbone=GPT-4o-mini2026.01 | 0.047 | 7,069 | |
| SoKG (Ours)LLM Backbone=Claude-42026.01 | 0.039 | 14,849 | |
| GraphRAGLLM Backbone=GPT-4o-mini2026.01 | 0.038 | 1,076 | |
| Direct ExtractionLLM Backbone=Gemini-2.52026.01 | 0.038 | 7,315 | |
| GraphRAGLLM Backbone=Gemini-2.52026.01 | 0.036 | 1,848 | |
| SoKG (w/o 5W1H)LLM Backbone=Gemini-2.52026.01 | 0.034 | 7,875 | |
| KGGenLLM Backbone=Gemini-2.52026.01 | 0.03 | 5,301 | |
| SoKG (Ours)LLM Backbone=Gemini-2.52026.01 | 0.023 | 9,612 |