Knowledge Graph Information Retention on MINE-1
89MINE-1 ScorePAI-2
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| PAI-2LLM=Qwen2.5 7B2026.05 | 89 | — | — | — | — | — | — | — | — | |
| WikonticLLM Backbone=gpt4.1-mini2025.11 | 86 | — | — | — | — | — | — | — | — | |
| WikonticLLM=gpt4.1-mini2026.05 | 86 | — | — | — | — | — | — | — | — | |
| WikonticLLM Backbone=gpt4o2025.11 | 84 | — | — | — | — | — | — | — | — | |
| WikonticLLM=gpt4o2026.05 | 84 | — | — | — | — | — | — | — | — | |
| KGGenLLM Backbone=Claude Sonnet 3.52025.11 | 73 | — | — | — | — | — | — | — | — | |
| KGGenLLM=Claude Sonnet 3.52026.05 | 73 | — | — | — | — | — | — | — | — | |
| KGGenLLM Backbone=GPT-4o2025.11 | 66 | — | — | — | — | — | — | — | — | |
| KGGenLLM=GPT-4o2026.05 | 66 | — | — | — | — | — | — | — | — | |
| GraphRAGLLM Backbone=gpt4o2025.11 | 48 | — | — | — | — | — | — | — | — | |
| KGGenLLM Backbone=Gemini 2.0 Flash2025.11 | 44 | — | — | — | — | — | — | — | — | |
| KGGenLLM=Gemini 2.0 Flash2026.05 | 44 | — | — | — | — | — | — | — | — | |
| GraphRAGLLM=gpt4o2026.05 | 44 | — | — | — | — | — | — | — | — | |
| KGGenLLM=Qwen2.5 14B2026.05 | 39 | — | — | — | — | — | — | — | — | |
| WikonticLLM=Gemma3 12B2026.05 | 28 | — | — | — | — | — | — | — | — | |
| WikonticLLM=Qwen2.5 14B2026.05 | 19 | — | — | — | — | — | — | — | — | |
| KGGenLLM=Gemma3 12B2026.05 | 14 | — | — | — | — | — | — | — | — | |
| AutoSchemaKG2026.04 | — | 95.1 | 37.3 | 58.7 | 4.7 | 36.5 | 3.599 | 61.5 | 3.33 | |
| GraphRAG2026.04 | — | 48.4 | 45.1 | 45.1 | 14.6 | 0 | 0.394 | 91.5 | 2.67 | |
| KGGen2026.04 | — | 63.6 | 30.1 | 30.1 | 0.5 | 0 | 0.494 | 46.1 | 4 | |
| OpenIE2026.04 | — | 56 | 40.5 | 41.5 | 2.4 | 2.3 | 3.201 | 74 | 3.56 | |
| TRACE-KG2026.04 | — | 90.2 | 78.5 | 79.6 | 27 | 1.3 | 0.956 | 88.5 | 1.44 |