List your company

Factuality Evaluation on AggreFact (FTSOTA)

70.5Balanced Accuracy (CNN-FTS)FENICE_GPT_claims
51.7856.6461.566.36Mar 4, 2024

Evaluation results

MethodLinks
FENICE_GPT_claimsthresholding=single-threshold, claim_extractor=LLM-based (GPT)2024.0370.572.871.6
QuestEvalthresholding=single-threshold2024.0370.259.564.9
QAFactEvalthresholding=single-threshold2024.0367.863.965.9
FENICE_T5_claimsthresholding=single-threshold, claim_extractor=knowledge-distilled (T5)2024.0367.770.168.9
DAEthresholding=single-threshold2024.0365.470.267.8
SummaC-ZSthresholding=single-threshold2024.036456.460.2
MENLIthresholding=single-threshold2024.0363.45961.2
AlignScorethresholding=single-threshold2024.0362.769.466.1
TrueTeacher-11Bthresholding=single-threshold, parameters=11B2024.036274.968.4
SummaC-Convthresholding=single-threshold2024.03616563
ChatGPT-ZSthresholding=single-threshold, mode=zero-shot2024.0356.362.759.5
ChatGPT-Starthresholding=single-threshold2024.0356.357.857.1
ChatGPT-DAthresholding=single-threshold2024.0353.754.954.3
ChatGPT-COTthresholding=single-threshold, mode=chain-of-thought2024.0352.555.954.2