Image Caption Evaluation on FOIL (4-ref)
94.64AccuracyBERTScore + SoftSPICE(img)
Evaluation Results
| Method | Links | |
|---|---|---|
| BERTScore + SoftSPICE(img)Parser=FACTUAL-T5, Combination=Harmonic Mean2023.05 | 94.64 | |
| RefCLIPScore + SoftSPICE(img)Parser=FACTUAL-T5, Combination=Harmonic Mean2023.05 | 94.01 | |
| RefCLIPScore2023.05 | 92.4 | |
| SoftSPICE(img)Parser=FACTUAL-T5, Include Image Information=true2023.05 | 92.31 | |
| FACTUAL-T5(pre)Metric=SoftSPICE2023.05 | 91.61 | |
| SoftSPICEParser=FACTUAL-T52023.05 | 91.61 | |
| BERTScore2023.05 | 90.49 | |
| SPICE-ParserMetric=SPICE2023.05 | 87.02 | |
| FACTUAL-T5(pre)Metric=SPICE2023.05 | 86.88 | |
| CLIPScore2023.05 | 86.85 | |
| SPICE-ParserMetric=SoftSPICE2023.05 | 86.77 | |
| VG-T5Metric=SoftSPICE2023.05 | 76.77 | |
| VG-T5Metric=SPICE2023.05 | 76.12 | |
| CDP-T5Metric=SPICE2023.05 | 72.76 | |
| CDP-T5Metric=SoftSPICE2023.05 | 59.49 |