# Faithful Narrative Generation on Diabetes Source: [Faithful Narrative Generation on Diabetes]() Collection index: [llms.txt]() Data updated: 2026-03-23T11:44:27.232Z Evaluation of models generating faithful narratives using the Diabetes dataset, measured by RA, SA, VA, and the count of unfaithful narratives. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Faithful Narrative Generation | | Dataset (including any stated split) | diabetes | | Metric | RA | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [RA](): Higher is better; unit: SCALAR. - [SA](): Higher is better; unit: SCALAR. - [VA](): Higher is better; unit: SCALAR. - [Unfaithful Narrative Count](): Lower is better; unit: SCALAR. ## Recorded results | Method | RA | Result date | Report paper | | --- | --- | --- | --- | | Basic Design | 0.975 | Not recorded | 69c0c8ee0636e5bf4afc3aba | | Critic-Rule Design | 0.975 | Not recorded | 69c0c8ee0636e5bf4afc3aba | | Critic-Rule Design | 0.975 | Not recorded | 69c0c8ee0636e5bf4afc3aba | | Basic Design | 0.95 | Not recorded | 69c0c8ee0636e5bf4afc3aba | | Critic Design | 0.95 | Not recorded | 69c0c8ee0636e5bf4afc3aba | | Critic Design | 0.95 | Not recorded | 69c0c8ee0636e5bf4afc3aba | | Coherent-Rule Design | 0.925 | Not recorded | 69c0c8ee0636e5bf4afc3aba | | Coherent Design | 0.888 | Not recorded | 69c0c8ee0636e5bf4afc3aba | | Coherent Design | 0.875 | Not recorded | 69c0c8ee0636e5bf4afc3aba | | Baseline | 0.838 | Not recorded | 69c0c8ee0636e5bf4afc3aba | | Basic Design | 0.838 | Not recorded | 69c0c8ee0636e5bf4afc3aba | | Critic Design | 0.838 | Not recorded | 69c0c8ee0636e5bf4afc3aba | | Critic-Rule Design | 0.838 | Not recorded | 69c0c8ee0636e5bf4afc3aba | | Coherent Design | 0.838 | Not recorded | 69c0c8ee0636e5bf4afc3aba | | Coherent-Rule Design | 0.838 | Not recorded | 69c0c8ee0636e5bf4afc3aba | | Coherent-Rule Design | 0.838 | Not recorded | 69c0c8ee0636e5bf4afc3aba | ### Basic Design RA: 0.975. Result ID: 69c1274047f34ce924a9b474. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Design":"Basic Design","Round":"2","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction. ### Critic-Rule Design RA: 0.975. Result ID: 69c1274047f34ce924a9b479. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Design":"Critic-Rule Design","Round":"1","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction. ### Critic-Rule Design RA: 0.975. Result ID: 69c1274047f34ce924a9b47a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Design":"Critic-Rule Design","Round":"2","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction. ### Basic Design RA: 0.95. Result ID: 69c1274047f34ce924a9b473. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Design":"Basic Design","Round":"1","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction. ### Critic Design RA: 0.95. Result ID: 69c1274047f34ce924a9b476. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Design":"Critic Design","Round":"1","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction. ### Critic Design RA: 0.95. Result ID: 69c1274047f34ce924a9b477. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Design":"Critic Design","Round":"2","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction. ### Coherent-Rule Design RA: 0.925. Result ID: 69c1274047f34ce924a9b480. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Design":"Coherent-Rule Design","Round":"2","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction. ### Coherent Design RA: 0.888. Result ID: 69c1274047f34ce924a9b47c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Design":"Coherent Design","Round":"1","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction. ### Coherent Design RA: 0.875. Result ID: 69c1274047f34ce924a9b47d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Design":"Coherent Design","Round":"2","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction. ### Baseline RA: 0.838. Result ID: 69c1274047f34ce924a9b471. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Design":"Baseline","Round":"0","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction. ### Basic Design RA: 0.838. Result ID: 69c1274047f34ce924a9b472. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Design":"Basic Design","Round":"0","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction. ### Critic Design RA: 0.838. Result ID: 69c1274047f34ce924a9b475. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Design":"Critic Design","Round":"0","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction. ### Critic-Rule Design RA: 0.838. Result ID: 69c1274047f34ce924a9b478. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Design":"Critic-Rule Design","Round":"0","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction. ### Coherent Design RA: 0.838. Result ID: 69c1274047f34ce924a9b47b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Design":"Coherent Design","Round":"0","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction. ### Coherent-Rule Design RA: 0.838. Result ID: 69c1274047f34ce924a9b47e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Design":"Coherent-Rule Design","Round":"0","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction. ### Coherent-Rule Design RA: 0.838. Result ID: 69c1274047f34ce924a9b47f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Design":"Coherent-Rule Design","Round":"1","Backbone":"Claude Sonnet 4.5"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.