List your company
ResearchFormerly WizWand

Factual Consistency Evaluation on FRANK-XSum (FRK-X)

32.1Spearman CorrelationDAE
0.2768.53816.825.062May 26, 2023Jun 1, 2023Jun 8, 2023Jun 15, 2023Jun 22, 2023Jun 29, 2023Jul 6, 2023
Updated 8mo ago

Evaluation results

MethodLinks
DAEType=NLI2023.0532.1
ALIGNModel size=large2023.0730
ALIGNSCORE-largeType=Ours2023.0529
ALIGNSCORE-baseType=Ours2023.0528
UniEvalType=Misc2023.0526.7
UniEval2023.0726.7
QAFactEvalType=QA2023.0525.5
QAFactEval2023.0725.5
ALIGNModel size=base2023.0725.5
CTCType=Misc2023.0520.4
CTC2023.0720.4
BARTScoreType=Misc2023.0520
BARTScore2023.0720
QuestEvalType=QA2023.0519.1
BLEURTType=Regression2023.0513.9
BLEURT2023.0713.9
SimCSEType=Similarity Matching2023.0513.3
SummaC-ZSType=NLI2023.0512.8
BERTScoreType=Similarity Matching2023.0512.7
BERTScore2023.0712.7
MNLIType=NLI2023.0511.7
NER-OverlapType=Similarity Matching2023.0511.3
SummaC-CONVType=NLI2023.0511
ROUGE-LType=Similarity Matching2023.058.2
FactCCType=Misc2023.057.9
BLANCType=Misc2023.056.5
BLEUType=Similarity Matching2023.056.3
ROUGE-1Type=Similarity Matching2023.055.6
ROUGE-2Type=Similarity Matching2023.052.8
FEQAType=QA2023.051.5