# Narrative Generation Evaluation on Creativityprism 2025 (test)

Source: [Narrative Generation Evaluation on Creativityprism 2025 (test)](<https://www.sota2.com/research/sota/narrative-generation-evaluation-on-creativityprism-2025-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-17T10:12:43.649Z

Evaluation of narrative generation models on the test split of the Creativityprism 2025 dataset, assessed using metrics covering narrative quality components (NC, CR, ER, PS, CD, SD, GR, FL, DI, OQ).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Narrative Generation Evaluation |
| Dataset (including any stated split) | Creativityprism 2025 (test) |
| Metric | Narrative Coherence (NC) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 9 of 9 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Narrative Coherence (NC)](<https://www.sota2.com/research/sota/narrative-generation-evaluation-on-creativityprism-2025-test.md?metric=Narrative%20Coherence%20(NC)>): Higher is better; unit: PERCENT.

- [Consistency/Cohesion (CR)](<https://www.sota2.com/research/sota/narrative-generation-evaluation-on-creativityprism-2025-test.md?metric=Consistency%2FCohesion%20(CR)>): Higher is better; unit: PERCENT.

- [Engagement Rate (ER)](<https://www.sota2.com/research/sota/narrative-generation-evaluation-on-creativityprism-2025-test.md?metric=Engagement%20Rate%20(ER)>): Higher is better; unit: PERCENT.

- [Plot Structure (PS)](<https://www.sota2.com/research/sota/narrative-generation-evaluation-on-creativityprism-2025-test.md?metric=Plot%20Structure%20(PS)>): Higher is better; unit: PERCENT.

- [Character Development (CD)](<https://www.sota2.com/research/sota/narrative-generation-evaluation-on-creativityprism-2025-test.md?metric=Character%20Development%20(CD)>): Higher is better; unit: PERCENT.

- [Story Depth (SD)](<https://www.sota2.com/research/sota/narrative-generation-evaluation-on-creativityprism-2025-test.md?metric=Story%20Depth%20(SD)>): Higher is better; unit: PERCENT.

- [Grammar/Fluency (GR)](<https://www.sota2.com/research/sota/narrative-generation-evaluation-on-creativityprism-2025-test.md?metric=Grammar%2FFluency%20(GR)>): Higher is better; unit: PERCENT.

- [Fluency (FL)](<https://www.sota2.com/research/sota/narrative-generation-evaluation-on-creativityprism-2025-test.md?metric=Fluency%20(FL)>): Higher is better; unit: PERCENT.

- [Diversity (DI)](<https://www.sota2.com/research/sota/narrative-generation-evaluation-on-creativityprism-2025-test.md?metric=Diversity%20(DI)>): Higher is better; unit: PERCENT.

- [Overall Quality (OQ)](<https://www.sota2.com/research/sota/narrative-generation-evaluation-on-creativityprism-2025-test.md?metric=Overall%20Quality%20(OQ)>): Higher is better; unit: PERCENT.

- [Average Score](<https://www.sota2.com/research/sota/narrative-generation-evaluation-on-creativityprism-2025-test.md?metric=Average%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Narrative Coherence (NC) | Result date | Report paper |
| --- | --- | --- | --- |
| BiT-MCTS | 100 | Not recorded | 69b8e0170636e5bf4afbead7 |
| BiT-MCTS | 100 | Not recorded | 69b8e0170636e5bf4afbead7 |
| BiT-MCTS | 100 | Not recorded | 69b8e0170636e5bf4afbead7 |
| BiT-MCTS | 85 | Not recorded | 69b8e0170636e5bf4afbead7 |
| BiT-MCTS | 80 | Not recorded | 69b8e0170636e5bf4afbead7 |
| BiT-MCTS | 70 | Not recorded | 69b8e0170636e5bf4afbead7 |
| BiT-MCTS | 55 | Not recorded | 69b8e0170636e5bf4afbead7 |
| BiT-MCTS | 55 | Not recorded | 69b8e0170636e5bf4afbead7 |
| BiT-MCTS | 35 | Not recorded | 69b8e0170636e5bf4afbead7 |

### BiT-MCTS

Narrative Coherence (NC): 100. Result ID: 69b9290a47f34ce924a26a79.

[Reporting paper](<https://www.sota2.com/research/paper/69b8e0170636e5bf4afbead7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b8e0170636e5bf4afbead7.md>)

Recorded evaluation configuration: {"LLM Judge":"DeepSeek-V3","Against":"Vanilla"}. This record does not assert independent reproduction.

### BiT-MCTS

Narrative Coherence (NC): 100. Result ID: 69b9290a47f34ce924a26a7c.

[Reporting paper](<https://www.sota2.com/research/paper/69b8e0170636e5bf4afbead7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b8e0170636e5bf4afbead7.md>)

Recorded evaluation configuration: {"LLM Judge":"GPT-5-Mini","Against":"Vanilla"}. This record does not assert independent reproduction.

### BiT-MCTS

Narrative Coherence (NC): 100. Result ID: 69b9290a47f34ce924a26a7d.

[Reporting paper](<https://www.sota2.com/research/paper/69b8e0170636e5bf4afbead7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b8e0170636e5bf4afbead7.md>)

Recorded evaluation configuration: {"LLM Judge":"GPT-5-Mini","Against":"StoryWriter"}. This record does not assert independent reproduction.

### BiT-MCTS

Narrative Coherence (NC): 85. Result ID: 69b9290a47f34ce924a26a80.

[Reporting paper](<https://www.sota2.com/research/paper/69b8e0170636e5bf4afbead7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b8e0170636e5bf4afbead7.md>)

Recorded evaluation configuration: {"LLM Judge":"Gemini-2.5-Flash","Against":"StoryWriter"}. This record does not assert independent reproduction.

### BiT-MCTS

Narrative Coherence (NC): 80. Result ID: 69b9290a47f34ce924a26a7f.

[Reporting paper](<https://www.sota2.com/research/paper/69b8e0170636e5bf4afbead7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b8e0170636e5bf4afbead7.md>)

Recorded evaluation configuration: {"LLM Judge":"Gemini-2.5-Flash","Against":"Vanilla"}. This record does not assert independent reproduction.

### BiT-MCTS

Narrative Coherence (NC): 70. Result ID: 69b9290a47f34ce924a26a7e.

[Reporting paper](<https://www.sota2.com/research/paper/69b8e0170636e5bf4afbead7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b8e0170636e5bf4afbead7.md>)

Recorded evaluation configuration: {"LLM Judge":"GPT-5-Mini","Against":"Narrative Studio"}. This record does not assert independent reproduction.

### BiT-MCTS

Narrative Coherence (NC): 55. Result ID: 69b9290a47f34ce924a26a7a.

[Reporting paper](<https://www.sota2.com/research/paper/69b8e0170636e5bf4afbead7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b8e0170636e5bf4afbead7.md>)

Recorded evaluation configuration: {"LLM Judge":"DeepSeek-V3","Against":"StoryWriter"}. This record does not assert independent reproduction.

### BiT-MCTS

Narrative Coherence (NC): 55. Result ID: 69b9290a47f34ce924a26a81.

[Reporting paper](<https://www.sota2.com/research/paper/69b8e0170636e5bf4afbead7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b8e0170636e5bf4afbead7.md>)

Recorded evaluation configuration: {"LLM Judge":"Gemini-2.5-Flash","Against":"Narrative Studio"}. This record does not assert independent reproduction.

### BiT-MCTS

Narrative Coherence (NC): 35. Result ID: 69b9290a47f34ce924a26a7b.

[Reporting paper](<https://www.sota2.com/research/paper/69b8e0170636e5bf4afbead7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b8e0170636e5bf4afbead7.md>)

Recorded evaluation configuration: {"LLM Judge":"DeepSeek-V3","Against":"Narrative Studio"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
