List your company

Factuality Evaluation on AggreFact-XSum FTS

80.2Balanced AccuracyAlignScore
48.79256.94665.173.254Mar 4, 2024

Evaluation results

MethodLinks
AlignScore2024.0380.2
TrueTeacher-11BParameters=11B2024.0375.2
FENICEGPT_claimsExtractor=LLM-based claims2024.0373.9
DAENote=Trained on XSumFaith2024.0373.1
FENICET5_claimsExtractor=Knowledge-distilled claim extractor2024.0371.4
SummaC-Cvvariant=Convolutional2024.0367
QAFactEval2024.0365.9
ChatGPT-ZSPrompting=Zero-shot2024.0362.6
QuestEval2024.0361.6
MENLI2024.0358.3
ChatGPT-StarPrompting=Scale-based2024.0357.7
SummaC-ZSvariant=Zero-shot2024.0356.1
ChatGPT-CoTPrompting=Chain-of-Thought2024.0356
ChatGPT-DAPrompting=Direct Assessment2024.0353.6
Random Baseline2024.0350