List your company
ResearchFormerly WizWand

Factual Consistency Evaluation on XSum-Faithful (XSF)

47Spearman CorrelationDAE
-0.11212.11924.3536.581May 26, 2023
Updated 8mo ago

Evaluation results

MethodLinks
DAEType=NLI2023.0547
ALIGNSCORE-baseType=Ours2023.0543.8
QuestEvalType=QA2023.0542.1
BLEURTType=Regression2023.0537
ROUGE-1Type=Similarity Matching2023.0534.2
ALIGNSCORE-largeType=Ours2023.0533.3
QAFactEvalType=QA2023.0531.9
CTCType=Misc2023.0529.8
BARTScoreType=Misc2023.0529.8
SimCSEType=Similarity Matching2023.0529.2
ROUGE-LType=Similarity Matching2023.0528.9
ROUGE-2Type=Similarity Matching2023.0526.8
UniEvalType=Misc2023.0525.3
NER-OverlapType=Similarity Matching2023.0523.9
SummaC-CONVType=NLI2023.0521.7
BLEUType=Similarity Matching2023.0518.2
BERTScoreType=Similarity Matching2023.0513.4
BLANCType=Misc2023.058.4
MNLIType=NLI2023.057
FactCCType=Misc2023.056.8
SummaC-ZSType=NLI2023.055.7
FEQAType=QA2023.051.7