# Factuality Evaluation on Long-form summarization factuality dataset (test)

Source: [Factuality Evaluation on Long-form summarization factuality dataset (test)](<https://www.sota2.com/research/sota/factuality-evaluation-on-long-form-summarization-factuality-dataset-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:37:32.616Z

Evaluation of model factuality on the test split of the Long-form summarization factuality dataset, measured using Balanced Accuracy.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Factuality Evaluation |
| Dataset (including any stated split) | Long-form summarization factuality dataset (test) |
| Metric | Balanced Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 5 of 5 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Balanced Accuracy](<https://www.sota2.com/research/sota/factuality-evaluation-on-long-form-summarization-factuality-dataset-test.md?metric=Balanced%20Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Balanced Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| FENICE | 66.2 | Not recorded | 68fa74ae1e209131cea632b2 |
| FENICE | 65.7 | Not recorded | 68fa74ae1e209131cea632b2 |
| MENLI | 61.7 | Not recorded | 68fa74ae1e209131cea632b2 |
| AlignScore | 61.3 | Not recorded | 68fa74ae1e209131cea632b2 |
| DAE | 51.4 | Not recorded | 68fa74ae1e209131cea632b2 |

### FENICE

Balanced Accuracy: 66.2. Result ID: 6993540b3a6c3148491537cf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

[Implementation](<https://huggingface.co/MoritzLaurer/DeBERTa-v3-large-mnli-fever-anli-ling-wanli>)

Recorded evaluation configuration: {"extractor":"GPT"}. This record does not assert independent reproduction.

### FENICE

Balanced Accuracy: 65.7. Result ID: 6993540b3a6c3148491537d0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

[Implementation](<https://huggingface.co/MoritzLaurer/DeBERTa-v3-large-mnli-fever-anli-ling-wanli>)

Recorded evaluation configuration: {"extractor":"T5"}. This record does not assert independent reproduction.

### MENLI

Balanced Accuracy: 61.7. Result ID: 6993540b3a6c3148491537cd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71a91e209131cea52674.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### AlignScore

Balanced Accuracy: 61.3. Result ID: 6993540b3a6c3148491537cc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f801e209131cea4607f.md>)

[Implementation](<https://github.com/yuh-zha/AlignScore>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### DAE

Balanced Accuracy: 51.4. Result ID: 6993540b3a6c3148491537ce.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68891e209131cea1cc4b.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
