List your company
ResearchFormerly WizWand

Factuality Evaluation on QAGS XSUM

53.9Pearson CorrelationALIGN
-13.184.23521.6539.065Jun 22, 2021Oct 24, 2021Feb 25, 2022Jun 29, 2022Oct 31, 2022Mar 4, 2023Jul 6, 2023
Updated 8mo ago

Evaluation results

MethodLinks
ALIGNModel size=large2023.0753.9
ALIGNModel size=base2023.0751.1
UniEval2023.0745.5
QAFactEval2023.0744.2
CTC2023.0730.6
BARTScore2023.0716.3
BLEURT2023.0713.2
BARTSCOREFine-tuning task=CNN2021.060.184
QAGS2021.060.175
ROUGE-22021.060.097
BARTSCOREFine-tuning task=CNN + Para2021.060.074
MoverScore2021.060.054
PRISM2021.060.025
ROUGE-L2021.060.024
BERTScore2021.060.024
BARTSCORESetup=Vanilla2021.060.009
ROUGE-12021.06-0.008
BARTSCOREFine-tuning task=CNN, Prompting=true2021.06-0.094
BERTScore2023.07-10.6