List your company

Factuality Evaluation on AggreFact-CNN (FTS)

70.3Balanced AccuracySummaC-Cv
47.10853.12959.1565.171Mar 4, 2024

Evaluation results

MethodLinks
SummaC-Cvvariant=Convolutional2024.0370.3
FENICEGPT_claimsExtractor=LLM-based claims2024.0368.2
ChatGPT-ZSPrompting=Zero-shot2024.0366.2
TrueTeacher-11BParameters=11B2024.0365.7
QuestEval2024.0363.7
SummaC-ZSvariant=Zero-shot2024.0363.3
QAFactEval2024.0361.6
FENICET5_claimsExtractor=Knowledge-distilled claim extractor2024.0361.6
DAENote=Trained on XSumFaith2024.0359.4
ChatGPT-StarPrompting=Scale-based2024.0355.8
AlignScore2024.0353.5
MENLI2024.0351.7
Random Baseline2024.0350
ChatGPT-CoTPrompting=Chain-of-Thought2024.0349.7
ChatGPT-DAPrompting=Direct Assessment2024.0348