List your company

Simile Quality Evaluation on Simile Quality Dataset 1.0 (test)

0.32Pearson PCCHAUSER
0.098480.155990.21350.27101Jun 13, 2023

Evaluation results

MethodLinks
HAUSERMetric Category=HAUSER, Sub-metric=Full Quality2023.060.320.292
HAUSER (-consistency_i)Metric Category=HAUSER, Ablation=Removal of image consistency sub-metric2023.060.3070.265
HAUSER (-consistency_s)Metric Category=HAUSER, Ablation=Removal of sentiment consistency sub-metric2023.060.2590.217
BLEU2Metric Category=N-gram-level2023.060.2550.208
METEORMetric Category=N-gram-level2023.060.2340.233
BLEU1Metric Category=N-gram-level2023.060.2290.218
Rouge2Metric Category=N-gram-level2023.060.210.19
HAUSER (-relevance)Metric Category=HAUSER, Ablation=Removal of relevance sub-metric2023.060.2060.194
BLEU3Metric Category=N-gram-level2023.060.1930.172
Rouge1Metric Category=N-gram-level2023.060.1850.176
RougeLMetric Category=N-gram-level2023.060.1730.152
BLEU4Metric Category=N-gram-level2023.060.1590.14
PerplexityMetric Category=Sentence-level2023.060.1570.12
BERTSlargeMetric Category=Sentence-level2023.060.1430.12
BERTSbaseMetric Category=Sentence-level2023.060.1070.075