# Factual Retention on MINE

Source: [Factual Retention on MINE](<https://www.sota2.com/research/sota/factual-retention-on-mine>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:45:08.380Z

Evaluation of model performance on the MINE dataset, measuring Factual Retention using the Factual retention score (%).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Factual Retention |
| Dataset (including any stated split) | MINE |
| Metric | Factual Retention (%) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 25 of 25 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Factual Retention (%)](<https://www.sota2.com/research/sota/factual-retention-on-mine.md?metric=Factual%20Retention%20(%25)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Factual Retention (%) | Result date | Report paper |
| --- | --- | --- | --- |
| SoKG (Ours) | 96.3 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| SoKG (w/o 5W1H) | 94.6 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| SoKG (Ours) | 89.3 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| SoKG (Ours) | 87.7 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| Direct Extraction | 86.8 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| SoKG (w/o 5W1H) | 85.6 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| Direct Extraction | 84.6 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| SoKG (Ours) | 83.9 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| SoKG (w/o 5W1H) | 83.5 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| SoKG (w/o 5W1H) | 80.5 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| Direct Extraction | 78.1 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| SoKG (Ours) | 73.4 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| KGGen | 69.1 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| Direct Extraction | 68.5 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| SoKG (w/o 5W1H) | 67.1 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| Direct Extraction | 66.5 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| KGGen | 66.4 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| KGGen | 62.5 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| GraphRAG | 59.7 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| KGGen | 56.7 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| GraphRAG | 52.3 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| GraphRAG | 49.5 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| GraphRAG | 49.3 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| GraphRAG | 48.5 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |
| KGGen | 44.3 | Not recorded | 6969c5dfe25ad2fa9d1ec6b7 |

### SoKG (Ours)

Factual Retention (%): 96.3. Result ID: 699683fa5698665ec4cc2cec.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

Recorded evaluation configuration: {"LLM Backbone":"Claude-4-Sonnet"}. This record does not assert independent reproduction.

### SoKG (w/o 5W1H)

Factual Retention (%): 94.6. Result ID: 699683fa5698665ec4cc2ce7.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

Recorded evaluation configuration: {"LLM Backbone":"Claude-4-Sonnet"}. This record does not assert independent reproduction.

### SoKG (Ours)

Factual Retention (%): 89.3. Result ID: 699683fa5698665ec4cc2cea.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

Recorded evaluation configuration: {"LLM Backbone":"GPT-4o"}. This record does not assert independent reproduction.

### SoKG (Ours)

Factual Retention (%): 87.7. Result ID: 699683fa5698665ec4cc2ceb.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

Recorded evaluation configuration: {"LLM Backbone":"Gemini-2.5-Flash-Lite"}. This record does not assert independent reproduction.

### Direct Extraction

Factual Retention (%): 86.8. Result ID: 699683fa5698665ec4cc2cd8.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

Recorded evaluation configuration: {"LLM Backbone":"Claude-4-Sonnet"}. This record does not assert independent reproduction.

### SoKG (w/o 5W1H)

Factual Retention (%): 85.6. Result ID: 699683fa5698665ec4cc2ce6.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

Recorded evaluation configuration: {"LLM Backbone":"Gemini-2.5-Flash-Lite"}. This record does not assert independent reproduction.

### Direct Extraction

Factual Retention (%): 84.6. Result ID: 699683fa5698665ec4cc2cd7.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

Recorded evaluation configuration: {"LLM Backbone":"Gemini-2.5-Flash-Lite"}. This record does not assert independent reproduction.

### SoKG (Ours)

Factual Retention (%): 83.9. Result ID: 699683fa5698665ec4cc2ce9.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

Recorded evaluation configuration: {"LLM Backbone":"GPT-4o-mini"}. This record does not assert independent reproduction.

### SoKG (w/o 5W1H)

Factual Retention (%): 83.5. Result ID: 699683fa5698665ec4cc2ce5.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

Recorded evaluation configuration: {"LLM Backbone":"GPT-4o"}. This record does not assert independent reproduction.

### SoKG (w/o 5W1H)

Factual Retention (%): 80.5. Result ID: 699683fa5698665ec4cc2ce4.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

Recorded evaluation configuration: {"LLM Backbone":"GPT-4o-mini"}. This record does not assert independent reproduction.

### Direct Extraction

Factual Retention (%): 78.1. Result ID: 699683fa5698665ec4cc2cd6.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

Recorded evaluation configuration: {"LLM Backbone":"GPT-4o"}. This record does not assert independent reproduction.

### SoKG (Ours)

Factual Retention (%): 73.4. Result ID: 699683fa5698665ec4cc2ce8.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

Recorded evaluation configuration: {"LLM Backbone":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction.

### KGGen

Factual Retention (%): 69.1. Result ID: 699683fa5698665ec4cc2ce2.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77031e209131cea707b3.md>)

Recorded evaluation configuration: {"LLM Backbone":"Claude-4-Sonnet"}. This record does not assert independent reproduction.

### Direct Extraction

Factual Retention (%): 68.5. Result ID: 699683fa5698665ec4cc2cd5.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

Recorded evaluation configuration: {"LLM Backbone":"GPT-4o-mini"}. This record does not assert independent reproduction.

### SoKG (w/o 5W1H)

Factual Retention (%): 67.1. Result ID: 699683fa5698665ec4cc2ce3.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

Recorded evaluation configuration: {"LLM Backbone":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction.

### Direct Extraction

Factual Retention (%): 66.5. Result ID: 699683fa5698665ec4cc2cd4.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

Recorded evaluation configuration: {"LLM Backbone":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction.

### KGGen

Factual Retention (%): 66.4. Result ID: 699683fa5698665ec4cc2ce0.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77031e209131cea707b3.md>)

Recorded evaluation configuration: {"LLM Backbone":"GPT-4o"}. This record does not assert independent reproduction.

### KGGen

Factual Retention (%): 62.5. Result ID: 699683fa5698665ec4cc2ce1.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77031e209131cea707b3.md>)

Recorded evaluation configuration: {"LLM Backbone":"Gemini-2.5-Flash-Lite"}. This record does not assert independent reproduction.

### GraphRAG

Factual Retention (%): 59.7. Result ID: 699683fa5698665ec4cc2cd9.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa770d1e209131cea70c5a.md>)

Recorded evaluation configuration: {"LLM Backbone":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction.

### KGGen

Factual Retention (%): 56.7. Result ID: 699683fa5698665ec4cc2cde.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77031e209131cea707b3.md>)

Recorded evaluation configuration: {"LLM Backbone":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction.

### GraphRAG

Factual Retention (%): 52.3. Result ID: 699683fa5698665ec4cc2cdd.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa770d1e209131cea70c5a.md>)

Recorded evaluation configuration: {"LLM Backbone":"Claude-4-Sonnet"}. This record does not assert independent reproduction.

### GraphRAG

Factual Retention (%): 49.5. Result ID: 699683fa5698665ec4cc2cda.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa770d1e209131cea70c5a.md>)

Recorded evaluation configuration: {"LLM Backbone":"GPT-4o-mini"}. This record does not assert independent reproduction.

### GraphRAG

Factual Retention (%): 49.3. Result ID: 699683fa5698665ec4cc2cdb.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa770d1e209131cea70c5a.md>)

Recorded evaluation configuration: {"LLM Backbone":"GPT-4o"}. This record does not assert independent reproduction.

### GraphRAG

Factual Retention (%): 48.5. Result ID: 699683fa5698665ec4cc2cdc.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa770d1e209131cea70c5a.md>)

Recorded evaluation configuration: {"LLM Backbone":"Gemini-2.5-Flash-Lite"}. This record does not assert independent reproduction.

### KGGen

Factual Retention (%): 44.3. Result ID: 699683fa5698665ec4cc2cdf.

[Reporting paper](<https://www.sota2.com/research/paper/6969c5dfe25ad2fa9d1ec6b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77031e209131cea707b3.md>)

Recorded evaluation configuration: {"LLM Backbone":"GPT-4o-mini"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
