List your company
ResearchFormerly WizWand

Image Caption Evaluation on FOIL (4-ref)

94.64AccuracyBERTScore + SoftSPICE(img)
58.08467.574577.06586.5555May 27, 2023
Updated 8mo ago

Evaluation results

MethodLinks
BERTScore + SoftSPICE(img)Parser=FACTUAL-T5, Combination=Harmonic Mean2023.0594.64
RefCLIPScore + SoftSPICE(img)Parser=FACTUAL-T5, Combination=Harmonic Mean2023.0594.01
RefCLIPScore2023.0592.4
SoftSPICE(img)Parser=FACTUAL-T5, Include Image Information=true2023.0592.31
FACTUAL-T5(pre)Metric=SoftSPICE2023.0591.61
SoftSPICEParser=FACTUAL-T52023.0591.61
BERTScore2023.0590.49
SPICE-ParserMetric=SPICE2023.0587.02
FACTUAL-T5(pre)Metric=SPICE2023.0586.88
CLIPScore2023.0586.85
SPICE-ParserMetric=SoftSPICE2023.0586.77
VG-T5Metric=SoftSPICE2023.0576.77
VG-T5Metric=SPICE2023.0576.12
CDP-T5Metric=SPICE2023.0572.76
CDP-T5Metric=SoftSPICE2023.0559.49