# Faithful Narrative Generation on student

Source: [Faithful Narrative Generation on student](<https://www.sota2.com/research/sota/faithful-narrative-generation-on-student>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-23T11:44:27.287Z

Evaluation of models generating faithful narratives using the 'student' dataset, measured by RA, SA, VA, and the count of unfaithful narratives.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Faithful Narrative Generation |
| Dataset (including any stated split) | student |
| Metric | RA |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 16 of 16 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [RA](<https://www.sota2.com/research/sota/faithful-narrative-generation-on-student.md?metric=RA>): Higher is better; unit: PERCENT.

- [SA](<https://www.sota2.com/research/sota/faithful-narrative-generation-on-student.md?metric=SA>): Higher is better; unit: PERCENT.

- [VA](<https://www.sota2.com/research/sota/faithful-narrative-generation-on-student.md?metric=VA>): Higher is better; unit: PERCENT.

- [Count of Unfaithful Narratives](<https://www.sota2.com/research/sota/faithful-narrative-generation-on-student.md?metric=Count%20of%20Unfaithful%20Narratives>): Lower is better; unit: SCALAR.

## Recorded results

| Method | RA | Result date | Report paper |
| --- | --- | --- | --- |
| Basic Design | 97.5 | Not recorded | 69c0c8ee0636e5bf4afc3aba |
| Basic Design | 97.5 | Not recorded | 69c0c8ee0636e5bf4afc3aba |
| Critic Design | 97.5 | Not recorded | 69c0c8ee0636e5bf4afc3aba |
| Critic Design | 97.5 | Not recorded | 69c0c8ee0636e5bf4afc3aba |
| Critic-Rule Design | 97.5 | Not recorded | 69c0c8ee0636e5bf4afc3aba |
| Critic-Rule Design | 97.5 | Not recorded | 69c0c8ee0636e5bf4afc3aba |
| Baseline | 92.5 | Not recorded | 69c0c8ee0636e5bf4afc3aba |
| Basic Design | 92.5 | Not recorded | 69c0c8ee0636e5bf4afc3aba |
| Critic Design | 92.5 | Not recorded | 69c0c8ee0636e5bf4afc3aba |
| Critic-Rule Design | 92.5 | Not recorded | 69c0c8ee0636e5bf4afc3aba |
| Coherent Design | 92.5 | Not recorded | 69c0c8ee0636e5bf4afc3aba |
| Coherent-Rule Design | 92.5 | Not recorded | 69c0c8ee0636e5bf4afc3aba |
| Coherent Design | 90 | Not recorded | 69c0c8ee0636e5bf4afc3aba |
| Coherent Design | 88.8 | Not recorded | 69c0c8ee0636e5bf4afc3aba |
| Coherent-Rule Design | 88.8 | Not recorded | 69c0c8ee0636e5bf4afc3aba |
| Coherent-Rule Design | 87.5 | Not recorded | 69c0c8ee0636e5bf4afc3aba |

### Basic Design

RA: 97.5. Result ID: 69c1274047f34ce924a9b493.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

Recorded evaluation configuration: {"Design":"Basic Design","Round":"1","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction.

### Basic Design

RA: 97.5. Result ID: 69c1274047f34ce924a9b494.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

Recorded evaluation configuration: {"Design":"Basic Design","Round":"2","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction.

### Critic Design

RA: 97.5. Result ID: 69c1274047f34ce924a9b496.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

Recorded evaluation configuration: {"Design":"Critic Design","Round":"1","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction.

### Critic Design

RA: 97.5. Result ID: 69c1274047f34ce924a9b497.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

Recorded evaluation configuration: {"Design":"Critic Design","Round":"2","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction.

### Critic-Rule Design

RA: 97.5. Result ID: 69c1274047f34ce924a9b499.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

Recorded evaluation configuration: {"Design":"Critic-Rule Design","Round":"1","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction.

### Critic-Rule Design

RA: 97.5. Result ID: 69c1274047f34ce924a9b49a.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

Recorded evaluation configuration: {"Design":"Critic-Rule Design","Round":"2","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction.

### Baseline

RA: 92.5. Result ID: 69c1274047f34ce924a9b491.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76381e209131cea6bed3.md>)

Recorded evaluation configuration: {"Design":"Baseline","Round":"0","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction.

### Basic Design

RA: 92.5. Result ID: 69c1274047f34ce924a9b492.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

Recorded evaluation configuration: {"Design":"Basic Design","Round":"0","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction.

### Critic Design

RA: 92.5. Result ID: 69c1274047f34ce924a9b495.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

Recorded evaluation configuration: {"Design":"Critic Design","Round":"0","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction.

### Critic-Rule Design

RA: 92.5. Result ID: 69c1274047f34ce924a9b498.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

Recorded evaluation configuration: {"Design":"Critic-Rule Design","Round":"0","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction.

### Coherent Design

RA: 92.5. Result ID: 69c1274047f34ce924a9b49b.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

Recorded evaluation configuration: {"Design":"Coherent Design","Round":"0","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction.

### Coherent-Rule Design

RA: 92.5. Result ID: 69c1274047f34ce924a9b49e.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

Recorded evaluation configuration: {"Design":"Coherent-Rule Design","Round":"0","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction.

### Coherent Design

RA: 90. Result ID: 69c1274047f34ce924a9b49d.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

Recorded evaluation configuration: {"Design":"Coherent Design","Round":"2","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction.

### Coherent Design

RA: 88.8. Result ID: 69c1274047f34ce924a9b49c.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

Recorded evaluation configuration: {"Design":"Coherent Design","Round":"1","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction.

### Coherent-Rule Design

RA: 88.8. Result ID: 69c1274047f34ce924a9b49f.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

Recorded evaluation configuration: {"Design":"Coherent-Rule Design","Round":"1","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction.

### Coherent-Rule Design

RA: 87.5. Result ID: 69c1274047f34ce924a9b4a0.

[Reporting paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c0c8ee0636e5bf4afc3aba.md>)

Recorded evaluation configuration: {"Design":"Coherent-Rule Design","Round":"2","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
