List your company
ResearchFormerly WizWand

Turn-level correlation evaluation on PersonaChat turn-level

0.4814Spearman CorrelationUSR-DR
-0.0707360.0726070.215950.359293May 1, 2020
Updated 8mo ago

Evaluation results

MethodLinks
USR-DRMetric Category=Reference Free Metrics, config=x = c2020.050.48140.6087
USRMetric Category=Reference Free Metrics2020.050.46930.4115
METEORMetric Category=Word-Overlap Metrics2020.050.25270.2713
USR2020.050.2430.1862
USR-DRx=c2020.050.22910.1733
BERTScoreMetric Category=Embedding Based Metrics, variant=base2020.050.1690.1526
Vector ExtremaMetric Category=Embedding Based Metrics2020.050.1570.141
BERTScoreMetric Category=Embedding Based Metrics, variant=large2020.050.15180.1211
F-1Metric Category=Word-Overlap Metrics2020.050.14220.1241
VectorExtrema2020.050.13750.1458
BLEU-4Metric Category=Word-Overlap Metrics2020.050.13530.0899
BLEU-3Metric Category=Word-Overlap Metrics2020.050.12020.0924
Embedding AverageMetric Category=Embedding Based Metrics2020.050.11820.1428
BLEU-2Metric Category=Word-Overlap Metrics2020.050.11220.0943
Greedy MatchingMetric Category=Embedding Based Metrics2020.050.09160.0625
USR-MLMMetric Category=Reference Free Metrics2020.050.07950.0788
ROUGE-LMetric Category=Word-Overlap Metrics2020.050.06590.0385
BLEU-1Metric Category=Word-Overlap Metrics2020.050.04340.0469
Skip-ThoughtMetric Category=Embedding Based Metrics2020.05-0.0393-0.0452
USR-DRMetric Category=Reference Free Metrics, config=x = f2020.05-0.0495-0.0454