# Holistic Unstructured Text Generation on UnFine-UnKE

Source: [Holistic Unstructured Text Generation on UnFine-UnKE](<https://www.sota2.com/research/sota/holistic-unstructured-text-generation-on-unfine-unke>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-15T09:02:35.964Z

Evaluation of models performing Holistic Unstructured Text Generation on the UnFine-UnKE dataset, measured using Bert-Score and Rouge-L.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Holistic Unstructured Text Generation |
| Dataset (including any stated split) | UnFine-UnKE |
| Metric | Bert-Score |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Bert-Score](<https://www.sota2.com/research/sota/holistic-unstructured-text-generation-on-unfine-unke.md?metric=Bert-Score>): Higher is better; unit: PERCENT.

- [Rouge-L](<https://www.sota2.com/research/sota/holistic-unstructured-text-generation-on-unfine-unke.md?metric=Rouge-L>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Bert-Score | Result date | Report paper |
| --- | --- | --- | --- |
| FABLE | 99.36 | Not recorded | 69df1b827d0172140ec7b8b2 |
| FABLE | 98.86 | Not recorded | 69df1b827d0172140ec7b8b2 |
| UnKE | 98.2 | Not recorded | 69df1b827d0172140ec7b8b2 |
| AnyEdit | 97.02 | Not recorded | 69df1b827d0172140ec7b8b2 |
| UnKE | 96.86 | Not recorded | 69df1b827d0172140ec7b8b2 |
| AnyEdit | 96.06 | Not recorded | 69df1b827d0172140ec7b8b2 |
| MEMIT | 81.78 | Not recorded | 69df1b827d0172140ec7b8b2 |
| MEMIT | 81.44 | Not recorded | 69df1b827d0172140ec7b8b2 |
| ROME | 79.51 | Not recorded | 69df1b827d0172140ec7b8b2 |
| ROME | 78.53 | Not recorded | 69df1b827d0172140ec7b8b2 |
| Pre-edited | 72.96 | Not recorded | 69df1b827d0172140ec7b8b2 |
| Pre-edited | 71.83 | Not recorded | 69df1b827d0172140ec7b8b2 |
| FT-L | 33.29 | Not recorded | 69df1b827d0172140ec7b8b2 |
| FT-L | 28.11 | Not recorded | 69df1b827d0172140ec7b8b2 |

### FABLE

Bert-Score: 99.36. Result ID: 69df531347f34ce924c83cdb.

[Reporting paper](<https://www.sota2.com/research/paper/69df1b827d0172140ec7b8b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69df1b827d0172140ec7b8b2.md>)

Recorded evaluation configuration: {"Model":"Llama3-8B"}. This record does not assert independent reproduction.

### FABLE

Bert-Score: 98.86. Result ID: 69df531347f34ce924c83ce2.

[Reporting paper](<https://www.sota2.com/research/paper/69df1b827d0172140ec7b8b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69df1b827d0172140ec7b8b2.md>)

Recorded evaluation configuration: {"Model":"Qwen2.5-7B"}. This record does not assert independent reproduction.

### UnKE

Bert-Score: 98.2. Result ID: 69df531347f34ce924c83cd9.

[Reporting paper](<https://www.sota2.com/research/paper/69df1b827d0172140ec7b8b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa771b1e209131cea71076.md>)

Recorded evaluation configuration: {"Model":"Llama3-8B"}. This record does not assert independent reproduction.

### AnyEdit

Bert-Score: 97.02. Result ID: 69df531347f34ce924c83ce1.

[Reporting paper](<https://www.sota2.com/research/paper/69df1b827d0172140ec7b8b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bfb1e209131cea8b9dd.md>)

[Implementation](<https://github.com/jianghoucheng/AnyEdit>)

Recorded evaluation configuration: {"Model":"Qwen2.5-7B"}. This record does not assert independent reproduction.

### UnKE

Bert-Score: 96.86. Result ID: 69df531347f34ce924c83ce0.

[Reporting paper](<https://www.sota2.com/research/paper/69df1b827d0172140ec7b8b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa771b1e209131cea71076.md>)

Recorded evaluation configuration: {"Model":"Qwen2.5-7B"}. This record does not assert independent reproduction.

### AnyEdit

Bert-Score: 96.06. Result ID: 69df531347f34ce924c83cda.

[Reporting paper](<https://www.sota2.com/research/paper/69df1b827d0172140ec7b8b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bfb1e209131cea8b9dd.md>)

[Implementation](<https://github.com/jianghoucheng/AnyEdit>)

Recorded evaluation configuration: {"Model":"Llama3-8B"}. This record does not assert independent reproduction.

### MEMIT

Bert-Score: 81.78. Result ID: 69df531347f34ce924c83cd8.

[Reporting paper](<https://www.sota2.com/research/paper/69df1b827d0172140ec7b8b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa703d1e209131cea49dc7.md>)

Recorded evaluation configuration: {"Model":"Llama3-8B"}. This record does not assert independent reproduction.

### MEMIT

Bert-Score: 81.44. Result ID: 69df531347f34ce924c83cdf.

[Reporting paper](<https://www.sota2.com/research/paper/69df1b827d0172140ec7b8b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa703d1e209131cea49dc7.md>)

Recorded evaluation configuration: {"Model":"Qwen2.5-7B"}. This record does not assert independent reproduction.

### ROME

Bert-Score: 79.51. Result ID: 69df531347f34ce924c83cd7.

[Reporting paper](<https://www.sota2.com/research/paper/69df1b827d0172140ec7b8b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e591e209131cea3f3c9.md>)

[Implementation](<https://rome.baulab.info/>)

Recorded evaluation configuration: {"Model":"Llama3-8B"}. This record does not assert independent reproduction.

### ROME

Bert-Score: 78.53. Result ID: 69df531347f34ce924c83cde.

[Reporting paper](<https://www.sota2.com/research/paper/69df1b827d0172140ec7b8b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e591e209131cea3f3c9.md>)

[Implementation](<https://rome.baulab.info/>)

Recorded evaluation configuration: {"Model":"Qwen2.5-7B"}. This record does not assert independent reproduction.

### Pre-edited

Bert-Score: 72.96. Result ID: 69df531347f34ce924c83cdc.

[Reporting paper](<https://www.sota2.com/research/paper/69df1b827d0172140ec7b8b2.md>)

Recorded evaluation configuration: {"Model":"Qwen2.5-7B"}. This record does not assert independent reproduction.

### Pre-edited

Bert-Score: 71.83. Result ID: 69df531347f34ce924c83cd5.

[Reporting paper](<https://www.sota2.com/research/paper/69df1b827d0172140ec7b8b2.md>)

Recorded evaluation configuration: {"Model":"Llama3-8B"}. This record does not assert independent reproduction.

### FT-L

Bert-Score: 33.29. Result ID: 69df531347f34ce924c83cd6.

[Reporting paper](<https://www.sota2.com/research/paper/69df1b827d0172140ec7b8b2.md>)

Recorded evaluation configuration: {"Model":"Llama3-8B"}. This record does not assert independent reproduction.

### FT-L

Bert-Score: 28.11. Result ID: 69df531347f34ce924c83cdd.

[Reporting paper](<https://www.sota2.com/research/paper/69df1b827d0172140ec7b8b2.md>)

Recorded evaluation configuration: {"Model":"Qwen2.5-7B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
