Human Correlation on VATEX EVAL 1 Reference
0.2863Kendall's TauEMScore_ref
Evaluation results
| Method | Links | ||
|---|---|---|---|
| EMScore_refCalculation=F1-measure, Weighting=idf2021.11 | 0.2863 | 0.3705 | |
| BERTScoreCalculation=F1-measure, Weighting=idf, Backbone=RoBERTa-base2021.11 | 0.1824 | 0.2373 | |
| CIDEr2021.11 | 0.1732 | 0.2263 | |
| METEOR2021.11 | 0.1644 | 0.2149 | |
| Improved BERTScoreCalculation=Recall, Weighting=idf, Backbone=RoBERTa-base2021.11 | 0.1516 | 0.198 | |
| ROUGE_L2021.11 | 0.1249 | 0.1631 | |
| BLEU_12021.11 | 0.1219 | 0.1591 | |
| BLEU_42021.11 | 0.0806 | 0.0881 |