Human Correlation on VATEX-EVAL 9 References
0.3681Kendall's Tau CorrelationEMScore_ref
Evaluation results
| Method | Links | ||
|---|---|---|---|
| EMScore_refCalculation=F1-measure, Weighting=idf2021.11 | 0.3681 | 0.4719 | |
| BERTScoreCalculation=F1-measure, Weighting=idf, Backbone=RoBERTa-base2021.11 | 0.293 | 0.3775 | |
| BLEU_12021.11 | 0.289 | 0.3697 | |
| CIDEr2021.11 | 0.2781 | 0.3606 | |
| METEOR2021.11 | 0.2763 | 0.3574 | |
| Improved BERTScoreCalculation=Recall, Weighting=idf, Backbone=RoBERTa-base2021.11 | 0.2442 | 0.3167 | |
| ROUGE_L2021.11 | 0.2378 | 0.3085 | |
| BLEU_42021.11 | 0.216 | 0.256 |