Human Judgment Correlation on VATEX EVAL (val)
38.1Kendall Tau-bRefPAC-S
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| RefPAC-SNumber of reference captions=92023.03 | 38.1 | 48.8 | |
| EMScoreNumber of reference captions=92023.03 | 36.8 | 47.2 | |
| RefPAC-SNumber of reference captions=12023.03 | 31.4 | 40.5 | |
| BERT-SNumber of reference captions=92023.03 | 29.3 | 37.8 | |
| BLEU-1Number of reference captions=92023.03 | 28.9 | 37 | |
| EMScoreNumber of reference captions=12023.03 | 28.6 | 37.1 | |
| CIDErNumber of reference captions=92023.03 | 27.8 | 36.1 | |
| METEORNumber of reference captions=92023.03 | 27.6 | 35.7 | |
| PAC-SNumber of reference captions=No Ref2023.03 | 25.1 | 32.6 | |
| BERT-S++Number of reference captions=92023.03 | 24.4 | 31.7 | |
| ROUGENumber of reference captions=92023.03 | 23.8 | 30.9 | |
| EMScoreNumber of reference captions=No Ref2023.03 | 23.2 | 30.3 | |
| BLEU-4Number of reference captions=92023.03 | 22.4 | 29.5 | |
| BERT-SNumber of reference captions=12023.03 | 18.2 | 23.7 | |
| CIDErNumber of reference captions=12023.03 | 17.3 | 22.6 | |
| METEORNumber of reference captions=12023.03 | 16.4 | 21.5 | |
| BERT-S++Number of reference captions=12023.03 | 15.2 | 19.8 | |
| BLEU-4Number of reference captions=12023.03 | 12.6 | 16.4 | |
| ROUGENumber of reference captions=12023.03 | 12.5 | 16.3 | |
| BLEU-1Number of reference captions=12023.03 | 12.2 | 15.9 |