List your company
ResearchFormerly WizWand

Factual Consistency Evaluation on SamSum (test)

44.6Pearson Correlation CoefficientALIGNSCORE-large
-6.366.8720.133.33May 26, 2023
Updated 8mo ago

Evaluation results

MethodLinks
ALIGNSCORE-largeType=Ours2023.0544.6
QAFactEvalType=QA2023.0538.9
MNLIType=NLI2023.0528
ALIGNSCORE-baseType=Ours2023.0523.9
UniEvalType=Misc2023.0523.2
ROUGE-2Type=Similarity Matching2023.0519.1
DAEType=NLI2023.0518.6
ROUGE-LType=Similarity Matching2023.0517.4
CTCType=Misc2023.0516.9
ROUGE-1Type=Similarity Matching2023.0516.7
NER-OverlapType=Similarity Matching2023.0516.7
BLEUType=Similarity Matching2023.0516.2
BARTScoreType=Misc2023.0515
SummaC-ZSType=NLI2023.0513.7
SummaC-CONVType=NLI2023.0512.4
BERTScoreType=Similarity Matching2023.0510.9
SimCSEType=Similarity Matching2023.0510.7
BLANCType=Misc2023.058.3
BLEURTType=Regression2023.058.1
FEQAType=QA2023.052.7
QuestEvalType=QA2023.050.4
FactCCType=Misc2023.05-4.4