List your company
ResearchFormerly WizWand

Correlation Evaluation on Topical-Chat

0.577Spearman CorrelationUniEval (Dial)
0.085080.212790.34050.46821May 1, 2020Nov 11, 2020May 25, 2021Dec 6, 2021Jun 18, 2022Dec 30, 2022Jul 13, 2023
Updated 8mo ago

Evaluation results

MethodLinks
UniEval (Dial)Training Dataset=Topical-Chat2023.070.577—
DecompEvalType=Instruction-tuned PLM (Zero-shot)2023.070.499—
USR - DR (x = c)component=Dialog Retrieval, context=context2020.050.48770.3533
USR2020.050.46450.4555
USR - DR (x = f)component=Dialog Retrieval, context=fact2020.050.44680.222
USRMetric Category=Reference Free Metrics, Type=Full USR Metric2020.050.41920.422
BERTScoreversion=base2020.050.41210.3901
METEOR2020.050.39090.3328
USR2020.050.37690.416
USR - DR (x = c)component=Dialog Retrieval, context=context2020.050.3650.3391
METEORMetric Category=Word-Overlap Metrics2020.050.33650.3908
USR2020.050.33530.3175
USR - MLMcomponent=Masked Language Model2020.050.32680.3264
USR - MLMcomponent=Masked Language Model2020.050.32540.337
USR - DR (x = c)Metric Category=Reference Free Metrics, Context=dialog context (c)2020.050.32450.4068
BERTScoreModel Version=base, Metric Category=Embedding Based Metrics2020.050.32290.354
USR2020.050.31520.2932
UniEval (Summ)Training Dataset=SummEval2023.070.315—
USR - MLMMetric Category=Reference Free Metrics, Sub-metric=Masked Language Modeling2020.050.30860.3345
USR2020.050.30370.2763
METEOR2020.050.30180.2495
BERTScoreModel Version=large, Metric Category=Embedding Based Metrics2020.050.29820.3252
BLEU-2Metric Category=Word-Overlap Metrics2020.050.28620.3012
ROUGE-LMetric Category=Word-Overlap Metrics2020.050.27450.287
BLEU-1Metric Category=Word-Overlap Metrics2020.050.27280.2876
BLEU-3Metric Category=Word-Overlap Metrics2020.050.25690.3006
BERTScoreversion=base2020.050.25020.2611
BLEU-4Metric Category=Word-Overlap Metrics2020.050.2160.2956
BERTScoreversion=base2020.050.20940.226
Vector ExtremaMetric Category=Embedding Based Metrics2020.050.20320.2091
Embedding AverageMetric Category=Embedding Based Metrics2020.050.18030.2038
Greedy MatchingMetric Category=Embedding Based Metrics2020.050.17120.1943
F-1Metric Category=Word-Overlap Metrics2020.050.16450.169
USR - DR (x = f)Metric Category=Reference Free Metrics, Context=fact (f)2020.050.14190.3221
Skip-ThoughtMetric Category=Embedding Based Metrics2020.050.1040.1181