Image Captioning Evaluation on Flickr8K-CF (test)
38.8Kendall tau_bRefFLEUR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RefFLEURType=reference+image, Explainable=true2024.06 | 38.8 | — | |
| FLEURType=reference-free, Explainable=true2024.06 | 38.6 | — | |
| PolosType=reference+image, Explainable=false2024.06 | 37.8 | — | |
| RefPAC-SType=Reference-based2023.03 | 37.6 | 19.5 | |
| RefPAC-SType=reference+image, Explainable=false2024.06 | 37.6 | — | |
| MID2022.05 | 37.3 | — | |
| MID2022.05 | 37.3 | — | |
| MIDType=Hybrid2023.03 | 37.3 | — | |
| CLIP + DN-refSetting=Reference-based2023.02 | 37 | — | |
| CLIP + DN*-refSetting=Reference-based2023.02 | 36.9 | — | |
| InfoMetIC+Type=reference-free, Explainable=false2024.06 | 36.6 | — | |
| RefCLIP-S2022.05 | 36.4 | — | |
| RefCLIP-Sreference-based=true2022.05 | 36.4 | — | |
| RefCLIP-SType=Reference-based2023.03 | 36.4 | 18.8 | |
| CLIP-refSetting=Reference-based2023.02 | 36.4 | — | |
| RefCLIPScoreType=reference+image, Explainable=false2024.06 | 36.4 | — | |
| PAC-SType=Reference-free2023.03 | 36 | 18.6 | |
| PAC-SType=reference-free, Explainable=false2024.06 | 36 | — | |
| CLIP + TTA + DNSetting=Reference-free2023.02 | 35.7 | — | |
| CLIP + TTA + DN*Setting=Reference-free2023.02 | 35.5 | — | |
| CLIP + DNSetting=Reference-free2023.02 | 35.4 | — | |
| CLIP + DN*Setting=Reference-free2023.02 | 35.1 | — | |
| CLIP + TTASetting=Reference-free2023.02 | 34.7 | — | |
| CLIP-S2022.05 | 34.4 | — | |
| CLIP-Sreference-free=true2022.05 | 34.4 | — | |
| CLIP-SType=Reference-free2023.03 | 34.4 | 17.7 | |
| CLIPScoreType=reference-free, Explainable=false2024.06 | 34.4 | — | |
| CLIPSetting=Reference-free2023.02 | 34.3 | — | |
| LEIC2022.05 | 29.5 | — | |
| LEIC2022.05 | 29.5 | — | |
| LEICType=Reference-based2023.03 | 29.5 | — | |
| TCL + DNSetting=Reference-free2023.02 | 26.4 | — | |
| CIDEr2022.05 | 24.6 | — | |
| CIDEr2022.05 | 24.6 | — | |
| CIDErType=Reference-based2023.03 | 24.6 | 12.7 | |
| CIDErSetting=Reference-based2023.02 | 24.6 | — | |
| CIDErType=reference-only, Explainable=false2024.06 | 24.6 | — | |
| SPICE2022.05 | 24.4 | — | |
| SPICE2022.05 | 24.4 | — | |
| SPICEType=Reference-based2023.03 | 24.4 | 12 | |
| SPICEType=reference-only, Explainable=false2024.06 | 24.4 | — | |
| TCL + DN*Setting=Reference-free2023.02 | 23.3 | — | |
| BERT-Sbackbone=RoBERTa-F2022.05 | 22.8 | — | |
| BERT Sbackbone=RoBERTa-F2022.05 | 22.8 | — | |
| BERT-SType=Reference-based2023.03 | 22.8 | — | |
| BERTScoreType=reference-only, Explainable=false2024.06 | 22.8 | — | |
| METEOR2022.05 | 22.2 | — | |
| METEOR2022.05 | 22.2 | — | |
| METEORType=Reference-based2023.03 | 22.2 | 11.5 | |
| METEORType=reference-only, Explainable=false2024.06 | 22.2 | — | |
| ALBEF + DNSetting=Reference-free2023.02 | 21.8 | — | |
| TCLSetting=Reference-free2023.02 | 20.6 | — | |
| ROUGE-L2022.05 | 19.9 | — | |
| ROUGE-L2022.05 | 19.9 | — | |
| ROUGEType=Reference-based2023.03 | 19.9 | 10.3 | |
| ROUGE-LType=reference-only, Explainable=false2024.06 | 19.9 | — | |
| ALBEF + DN*Setting=Reference-free2023.02 | 18.1 | — | |
| BLEU-1Type=Reference-based2023.03 | 17.9 | 9.3 | |
| BLEU-1Setting=Reference-based2023.02 | 17.9 | — | |
| BLEU-42022.05 | 16.9 | — | |
| BLEU-42022.05 | 16.9 | — | |
| BLEU-4Type=Reference-based2023.03 | 16.9 | 8.7 | |
| BLEU-4Setting=Reference-based2023.02 | 16.9 | — | |
| BLEU-4Type=reference-only, Explainable=false2024.06 | 16.9 | — | |
| ALBEFSetting=Reference-free2023.02 | 15.4 | — |