# Factuality Evaluation on AggreFact-CNN (FTS)

Source: [Factuality Evaluation on AggreFact-CNN (FTS)](<https://www.sota2.com/research/sota/factuality-evaluation-on-aggrefact-cnn-fts>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:37:32.524Z

Evaluation of model performance on the AggreFact-CNN (FTS) dataset for factuality assessment, typically measured using Balanced Accuracy.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Factuality Evaluation |
| Dataset (including any stated split) | AggreFact-CNN (FTS) |
| Metric | Balanced Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Balanced Accuracy](<https://www.sota2.com/research/sota/factuality-evaluation-on-aggrefact-cnn-fts.md?metric=Balanced%20Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Balanced Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| SummaC-Cv | 70.3 | Not recorded | 68fa74ae1e209131cea632b2 |
| FENICEGPT\_claims | 68.2 | Not recorded | 68fa74ae1e209131cea632b2 |
| ChatGPT-ZS | 66.2 | Not recorded | 68fa74ae1e209131cea632b2 |
| TrueTeacher-11B | 65.7 | Not recorded | 68fa74ae1e209131cea632b2 |
| QuestEval | 63.7 | Not recorded | 68fa74ae1e209131cea632b2 |
| SummaC-ZS | 63.3 | Not recorded | 68fa74ae1e209131cea632b2 |
| QAFactEval | 61.6 | Not recorded | 68fa74ae1e209131cea632b2 |
| FENICET5\_claims | 61.6 | Not recorded | 68fa74ae1e209131cea632b2 |
| DAE | 59.4 | Not recorded | 68fa74ae1e209131cea632b2 |
| ChatGPT-Star | 55.8 | Not recorded | 68fa74ae1e209131cea632b2 |
| AlignScore | 53.5 | Not recorded | 68fa74ae1e209131cea632b2 |
| MENLI | 51.7 | Not recorded | 68fa74ae1e209131cea632b2 |
| Random Baseline | 50 | Not recorded | 68fa74ae1e209131cea632b2 |
| ChatGPT-CoT | 49.7 | Not recorded | 68fa74ae1e209131cea632b2 |
| ChatGPT-DA | 48 | Not recorded | 68fa74ae1e209131cea632b2 |

### SummaC-Cv

Balanced Accuracy: 70.3. Result ID: 6993540b3a6c314849153778.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b421e209131cea2d015.md>)

Recorded evaluation configuration: {"variant":"Convolutional"}. This record does not assert independent reproduction.

### FENICEGPT\_claims

Balanced Accuracy: 68.2. Result ID: 6993540b3a6c314849153781.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

[Implementation](<https://huggingface.co/MoritzLaurer/DeBERTa-v3-large-mnli-fever-anli-ling-wanli>)

Recorded evaluation configuration: {"Extractor":"LLM-based claims"}. This record does not assert independent reproduction.

### ChatGPT-ZS

Balanced Accuracy: 66.2. Result ID: 6993540b3a6c31484915377d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f061e209131cea4358f.md>)

Recorded evaluation configuration: {"Prompting":"Zero-shot"}. This record does not assert independent reproduction.

### TrueTeacher-11B

Balanced Accuracy: 65.7. Result ID: 6993540b3a6c314849153779.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e61e209131cea4dd06.md>)

Recorded evaluation configuration: {"Parameters":"11B"}. This record does not assert independent reproduction.

### QuestEval

Balanced Accuracy: 63.7. Result ID: 6993540b3a6c314849153776.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69b91e209131cea23bee.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SummaC-ZS

Balanced Accuracy: 63.3. Result ID: 6993540b3a6c314849153777.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b421e209131cea2d015.md>)

Recorded evaluation configuration: {"variant":"Zero-shot"}. This record does not assert independent reproduction.

### QAFactEval

Balanced Accuracy: 61.6. Result ID: 6993540b3a6c31484915377a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c611e209131cea33b79.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### FENICET5\_claims

Balanced Accuracy: 61.6. Result ID: 6993540b3a6c314849153782.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

[Implementation](<https://huggingface.co/MoritzLaurer/DeBERTa-v3-large-mnli-fever-anli-ling-wanli>)

Recorded evaluation configuration: {"Extractor":"Knowledge-distilled claim extractor"}. This record does not assert independent reproduction.

### DAE

Balanced Accuracy: 59.4. Result ID: 6993540b3a6c314849153775.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68891e209131cea1cc4b.md>)

Recorded evaluation configuration: {"Note":"Trained on XSumFaith"}. This record does not assert independent reproduction.

### ChatGPT-Star

Balanced Accuracy: 55.8. Result ID: 6993540b3a6c314849153780.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f71e209131cea4e706.md>)

Recorded evaluation configuration: {"Prompting":"Scale-based"}. This record does not assert independent reproduction.

### AlignScore

Balanced Accuracy: 53.5. Result ID: 6993540b3a6c31484915377c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f801e209131cea4607f.md>)

[Implementation](<https://github.com/yuh-zha/AlignScore>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### MENLI

Balanced Accuracy: 51.7. Result ID: 6993540b3a6c31484915377b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71a91e209131cea52674.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Random Baseline

Balanced Accuracy: 50. Result ID: 6993540b3a6c314849153774.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### ChatGPT-CoT

Balanced Accuracy: 49.7. Result ID: 6993540b3a6c31484915377e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f061e209131cea4358f.md>)

Recorded evaluation configuration: {"Prompting":"Chain-of-Thought"}. This record does not assert independent reproduction.

### ChatGPT-DA

Balanced Accuracy: 48. Result ID: 6993540b3a6c31484915377f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f71e209131cea4e706.md>)

Recorded evaluation configuration: {"Prompting":"Direct Assessment"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
