List your company
ResearchFormerly WizWand

Caption-level correlation with human judgment on Composite (test)

0.6Kendall's TauRefCLIP-S
0.289040.369770.45050.53123Apr 18, 2021Apr 25, 2021May 3, 2021May 10, 2021May 18, 2021May 25, 2021Jun 2, 2021
Updated 8mo ago

Evaluation results

MethodLinks
RefCLIP-Sevaluation_setting=easier setting, number_of_references=4-52021.040.6
RefCLIP-Sevaluation_setting=harder setting, number_of_references=4-52021.040.554
CLIP-S (no refs)reference_usage=none2021.040.538
ViLBERTScore-Fevaluation_setting=harder setting, number_of_references=4-52021.040.524
TIGErevaluation_setting=harder setting, number_of_references=4-52021.040.454
BERT-S++evaluation_setting=harder setting, reported_in_prior_work=true, number_of_references=4-52021.040.449
SPICEEvaluation Level=Caption-level2021.060.445
SPARCSEvaluation Level=Caption-level2021.060.431
CIDErEvaluation Level=Caption-level2021.060.407
METEOREvaluation Level=Caption-level2021.060.404
SPICEevaluation_setting=harder setting, number_of_references=4-52021.040.403
Bleu-2Evaluation Level=Caption-level2021.060.394
Rouge-LEvaluation Level=Caption-level2021.060.393
METEORevaluation_setting=harder setting, number_of_references=4-52021.040.389
BERTScoreEvaluation Level=Caption-level2021.060.388
Bleu-1Evaluation Level=Caption-level2021.060.386
CIDErevaluation_setting=harder setting, number_of_references=4-52021.040.377
ROUGE-Levaluation_setting=harder setting, number_of_references=4-52021.040.324
BLEU-1evaluation_setting=harder setting, number_of_references=4-52021.040.313
BLEU-4evaluation_setting=harder setting, number_of_references=4-52021.040.306
BERT-S (RoBERTa-F)evaluation_setting=harder setting, number_of_references=4-52021.040.301