Image Caption Evaluation on FOIL 1-ref
90.94AccuracyRefCLIPScore
Evaluation Results
| Method | Links | |
|---|---|---|
| RefCLIPScore2023.05 | 90.94 | |
| RefCLIPScore + SoftSPICE(img)Parser=FACTUAL-T5, Combination=Harmonic Mean2023.05 | 90.69 | |
| BERTScore + SoftSPICE(img)Parser=FACTUAL-T5, Combination=Harmonic Mean2023.05 | 90.5 | |
| SoftSPICE(img)Parser=FACTUAL-T5, Include Image Information=true2023.05 | 88.12 | |
| CLIPScore2023.05 | 86.85 | |
| BERTScore2023.05 | 86.7 | |
| FACTUAL-T5(pre)Metric=SoftSPICE2023.05 | 85.66 | |
| SoftSPICEParser=FACTUAL-T52023.05 | 85.66 | |
| SPICE-ParserMetric=SoftSPICE2023.05 | 78.53 | |
| FACTUAL-T5(pre)Metric=SPICE2023.05 | 76.69 | |
| SPICE-ParserMetric=SPICE2023.05 | 76.31 | |
| VG-T5Metric=SoftSPICE2023.05 | 70.8 | |
| VG-T5Metric=SPICE2023.05 | 68.43 | |
| CDP-T5Metric=SPICE2023.05 | 65.66 | |
| CDP-T5Metric=SoftSPICE2023.05 | 53.58 |