List your company
ResearchFormerly WizWand

Factual Consistency Evaluation on SAMSum

46.7Spearman CorrelationALIGN
-6.4447.35321.1534.947May 26, 2023Jun 1, 2023Jun 8, 2023Jun 15, 2023Jun 22, 2023Jun 29, 2023Jul 6, 2023
Updated 8mo ago

Evaluation results

MethodLinks
ALIGNModel size=large2023.0746.7
ALIGNSCORE-largeType=Ours2023.0543.8
QAFactEvalType=QA2023.0535.9
QAFactEval2023.0735.9
MNLIType=NLI2023.0531.1
ALIGNSCORE-baseType=Ours2023.0523.4
UniEvalType=Misc2023.0522.8
UniEval2023.0722.8
ALIGNModel size=base2023.0722.3
DAEType=NLI2023.0518.6
CTCType=Misc2023.0517.7
CTC2023.0717.7
ROUGE-2Type=Similarity Matching2023.0517.5
NER-OverlapType=Similarity Matching2023.0516.7
ROUGE-LType=Similarity Matching2023.0516.3
BARTScoreType=Misc2023.0516.3
BARTScore2023.0716.3
ROUGE-1Type=Similarity Matching2023.0515.1
SummaC-ZSType=NLI2023.0515.1
BLEUType=Similarity Matching2023.0513.7
BERTScoreType=Similarity Matching2023.0513.1
BERTScore2023.0713.1
SummaC-CONVType=NLI2023.059.8
BLANCType=Misc2023.059.1
SimCSEType=Similarity Matching2023.057.9
BLEURTType=Regression2023.056.7
BLEURT2023.076.7
QuestEvalType=QA2023.053.9
FEQAType=QA2023.050
FactCCType=Misc2023.05-4.4