# Factual Consistency Evaluation on FRANK CNNDM Source: [Factual Consistency Evaluation on FRANK CNNDM]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:04:34.709Z Evaluation of model performance on the FRANK CNNDM dataset for factual consistency, measured using Spearman correlation. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Factual Consistency Evaluation | | Dataset (including any stated split) | FRANK CNNDM | | Metric | Spearman Correlation | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 30 of 30 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Spearman Correlation](): Higher is better; unit: SCALAR. ## Recorded results | Method | Spearman Correlation | Result date | Report paper | | --- | --- | --- | --- | | ALIGN | 61.8 | Not recorded | 68fa71131e209131cea4f1ee | | ALIGNSCORE-large | 60.9 | Not recorded | 68fa6f801e209131cea4607f | | ALIGN | 56.4 | Not recorded | 68fa71131e209131cea4f1ee | | ALIGNSCORE-base | 54.7 | Not recorded | 68fa6f801e209131cea4607f | | UniEval | 54 | Not recorded | 68fa6f801e209131cea4607f | | UniEval | 54 | Not recorded | 68fa71131e209131cea4f1ee | | QAFactEval | 53.7 | Not recorded | 68fa6f801e209131cea4607f | | QAFactEval | 53.7 | Not recorded | 68fa71131e209131cea4f1ee | | BARTScore | 53.3 | Not recorded | 68fa6f801e209131cea4607f | | BARTScore | 53.3 | Not recorded | 68fa71131e209131cea4f1ee | | SummaC-CONV | 52.4 | Not recorded | 68fa6f801e209131cea4607f | | CTC | 49.4 | Not recorded | 68fa6f801e209131cea4607f | | CTC | 49.4 | Not recorded | 68fa71131e209131cea4f1ee | | SummaC-ZS | 46.2 | Not recorded | 68fa6f801e209131cea4607f | | BERTScore | 45.1 | Not recorded | 68fa6f801e209131cea4607f | | BERTScore | 45.1 | Not recorded | 68fa71131e209131cea4f1ee | | QuestEval | 40.5 | Not recorded | 68fa6f801e209131cea4607f | | BLEURT | 37.6 | Not recorded | 68fa6f801e209131cea4607f | | BLEURT | 37.6 | Not recorded | 68fa71131e209131cea4f1ee | | ROUGE-2 | 37.2 | Not recorded | 68fa6f801e209131cea4607f | | DAE | 36.9 | Not recorded | 68fa6f801e209131cea4607f | | ROUGE-L | 35.8 | Not recorded | 68fa6f801e209131cea4607f | | FactCC | 35.3 | Not recorded | 68fa6f801e209131cea4607f | | ROUGE-1 | 35.2 | Not recorded | 68fa6f801e209131cea4607f | | BLANC | 34.2 | Not recorded | 68fa6f801e209131cea4607f | | BLEU | 34 | Not recorded | 68fa6f801e209131cea4607f | | SimCSE | 31.3 | Not recorded | 68fa6f801e209131cea4607f | | NER-Overlap | 27.8 | Not recorded | 68fa6f801e209131cea4607f | | FEQA | -2.9 | Not recorded | 68fa6f801e209131cea4607f | | MNLI | -5.5 | Not recorded | 68fa6f801e209131cea4607f | ### ALIGN Spearman Correlation: 61.8. Result ID: 699197373a6c3148490930fc. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model size":"large"}. This record does not assert independent reproduction. ### ALIGNSCORE-large Spearman Correlation: 60.9. Result ID: 6990c73d3a6c3148490335a5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Type":"Ours"}. This record does not assert independent reproduction. ### ALIGN Spearman Correlation: 56.4. Result ID: 699197373a6c3148490930fb. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model size":"base"}. This record does not assert independent reproduction. ### ALIGNSCORE-base Spearman Correlation: 54.7. Result ID: 6990c73d3a6c3148490335a4. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Type":"Ours"}. This record does not assert independent reproduction. ### UniEval Spearman Correlation: 54. Result ID: 6990c73d3a6c31484903359f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Misc"}. This record does not assert independent reproduction. ### UniEval Spearman Correlation: 54. Result ID: 699197373a6c3148490930f9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### QAFactEval Spearman Correlation: 53.7. Result ID: 6990c73d3a6c314849033592. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"QA"}. This record does not assert independent reproduction. ### QAFactEval Spearman Correlation: 53.7. Result ID: 699197373a6c3148490930fa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### BARTScore Spearman Correlation: 53.3. Result ID: 6990c73d3a6c3148490335a1. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Type":"Misc"}. This record does not assert independent reproduction. ### BARTScore Spearman Correlation: 53.3. Result ID: 699197373a6c3148490930f7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### SummaC-CONV Spearman Correlation: 52.4. Result ID: 6990c73d3a6c31484903359e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"NLI"}. This record does not assert independent reproduction. ### CTC Spearman Correlation: 49.4. Result ID: 6990c73d3a6c3148490335a0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Misc"}. This record does not assert independent reproduction. ### CTC Spearman Correlation: 49.4. Result ID: 699197373a6c3148490930f8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### SummaC-ZS Spearman Correlation: 46.2. Result ID: 6990c73d3a6c31484903359d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"NLI"}. This record does not assert independent reproduction. ### BERTScore Spearman Correlation: 45.1. Result ID: 6990c73d3a6c314849033597. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Similarity Matching"}. This record does not assert independent reproduction. ### BERTScore Spearman Correlation: 45.1. Result ID: 699197373a6c3148490930f5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### QuestEval Spearman Correlation: 40.5. Result ID: 6990c73d3a6c314849033591. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"QA"}. This record does not assert independent reproduction. ### BLEURT Spearman Correlation: 37.6. Result ID: 6990c73d3a6c31484903359a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Regression"}. This record does not assert independent reproduction. ### BLEURT Spearman Correlation: 37.6. Result ID: 699197373a6c3148490930f6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### ROUGE-2 Spearman Correlation: 37.2. Result ID: 6990c73d3a6c314849033594. [Reporting paper]() Recorded evaluation configuration: {"Type":"Similarity Matching"}. This record does not assert independent reproduction. ### DAE Spearman Correlation: 36.9. Result ID: 6990c73d3a6c31484903359c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"NLI"}. This record does not assert independent reproduction. ### ROUGE-L Spearman Correlation: 35.8. Result ID: 6990c73d3a6c314849033595. [Reporting paper]() Recorded evaluation configuration: {"Type":"Similarity Matching"}. This record does not assert independent reproduction. ### FactCC Spearman Correlation: 35.3. Result ID: 6990c73d3a6c3148490335a2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Misc"}. This record does not assert independent reproduction. ### ROUGE-1 Spearman Correlation: 35.2. Result ID: 6990c73d3a6c314849033593. [Reporting paper]() Recorded evaluation configuration: {"Type":"Similarity Matching"}. This record does not assert independent reproduction. ### BLANC Spearman Correlation: 34.2. Result ID: 6990c73d3a6c3148490335a3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Misc"}. This record does not assert independent reproduction. ### BLEU Spearman Correlation: 34. Result ID: 6990c73d3a6c314849033596. [Reporting paper]() Recorded evaluation configuration: {"Type":"Similarity Matching"}. This record does not assert independent reproduction. ### SimCSE Spearman Correlation: 31.3. Result ID: 6990c73d3a6c314849033599. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Type":"Similarity Matching"}. This record does not assert independent reproduction. ### NER-Overlap Spearman Correlation: 27.8. Result ID: 6990c73d3a6c314849033598. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Similarity Matching"}. This record does not assert independent reproduction. ### FEQA Spearman Correlation: -2.9. Result ID: 6990c73d3a6c314849033590. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"QA"}. This record does not assert independent reproduction. ### MNLI Spearman Correlation: -5.5. Result ID: 6990c73d3a6c31484903359b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"NLI"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.