Image Captioning on Pascal-50S (test)
70HCPolos
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| PolosType=reference+image, Explainable=false2024.06 | 70 | 99.6 | 97.4 | 79 | 86.5 | |
| RefFLEURType=reference+image, Explainable=true2024.06 | 68 | 99.8 | 98 | 76.1 | 85.5 | |
| RefPAC-SReference-based=true2023.03 | 67.7 | 99.6 | 96 | 75.6 | 84.7 | |
| RefPAC-SType=reference+image, Explainable=false2024.06 | 67.7 | 99.6 | 96 | 75.6 | 84.7 | |
| MID2022.05 | 67 | 99.7 | 97.4 | 76.8 | 85.2 | |
| MIDReference-based=true2023.03 | 67 | 99.7 | 97.4 | 76.8 | 85.2 | |
| CIDErReference-based=true2023.03 | 66.5 | 97.9 | 90.7 | 65.2 | 80.1 | |
| METEORReference-based=true2023.03 | 66 | 97.7 | 94 | 66.6 | 81.1 | |
| BERT-S (ROBERTa-F)2022.05 | 65.4 | 96.2 | 93.3 | 61.4 | 79.1 | |
| BERT-S++2022.05 | 65.4 | 98.1 | 96.4 | 60.3 | 80.1 | |
| BERT-S (ROBERTa-F)number of references=52021.04 | 65.4 | 96.2 | 93.3 | 61.4 | 79.1 | |
| BERT-S++number of references=5, source=reported in prior work2021.04 | 65.4 | 98.1 | 96.4 | 60.3 | 80.1 | |
| length2021.04 | 65.4 | 52.4 | 63 | 42.3 | 55.8 | |
| BERT-SReference-based=true2023.03 | 65.4 | 96.2 | 93.3 | 61.4 | 79.1 | |
| BERT-S++Reference-based=true2023.03 | 65.4 | 98.1 | 96.4 | 60.3 | 80.1 | |
| BERTScoreType=reference-only, Explainable=false2024.06 | 65.4 | 96.2 | 93.3 | 61.4 | 79.1 | |
| CIDEr2022.05 | 65.1 | 98.1 | 90.5 | 64.8 | 79.6 | |
| CIDErnumber of references=52021.04 | 65.1 | 98.1 | 90.5 | 64.8 | 79.6 | |
| RefCLIP-SReference-based=true2023.03 | 64.9 | 99.5 | 95.5 | 73.3 | 83.3 | |
| BLEU-1Reference-based=true2023.03 | 64.6 | 95.2 | 91.2 | 60.7 | 77.9 | |
| RefCLIP-S2022.05 | 64.5 | 99.6 | 95.4 | 72.8 | 83.1 | |
| RefCLIP-Snumber of references=52021.04 | 64.5 | 99.6 | 95.4 | 72.8 | 83.1 | |
| RefCLIPScoreType=reference+image, Explainable=false2024.06 | 64.5 | 99.6 | 95.4 | 72.8 | 83.1 | |
| ROUGEReference-based=true2023.03 | 63.9 | 95 | 92.3 | 60.9 | 78 | |
| METEOR2022.05 | 63.8 | 97.7 | 93.7 | 65.4 | 80.1 | |
| METEORnumber of references=52021.04 | 63.8 | 97.7 | 93.7 | 65.4 | 80.1 | |
| ROUGE-L2022.05 | 63.7 | 95.3 | 92.3 | 61.2 | 78.1 | |
| ROUGE-Lnumber of references=52021.04 | 63.7 | 95.3 | 92.3 | 61.2 | 78.1 | |
| SPICE2022.05 | 63.6 | 96.3 | 86.7 | 68.3 | 78.7 | |
| SPICEnumber of references=52021.04 | 63.6 | 96.3 | 86.7 | 68.3 | 78.7 | |
| FLEURType=reference-free, Explainable=true2024.06 | 61.3 | 99.7 | 97.6 | 74.2 | 83.2 | |
| PAC-SReference-based=false2023.03 | 60.6 | 99.3 | 96.9 | 72.9 | 82.4 | |
| PAC-SType=reference-free, Explainable=false2024.06 | 60.6 | 99.3 | 96.9 | 72.9 | 82.4 | |
| BLEU-42022.05 | 60.4 | 90.6 | 84.9 | 54.7 | 72.6 | |
| BLEU-1number of references=52021.04 | 60.4 | 90.6 | 84.9 | 54.7 | 72.6 | |
| CLIP-Sreferences=none2021.04 | 60.3 | 99.4 | 97.9 | 77.3 | 83.7 | |
| BLEU-4Reference-based=true2023.03 | 60.3 | 93.1 | 85.7 | 57 | 74 | |
| FAIErReference-based=true2023.03 | 59.7 | 99.9 | 92.7 | 73.4 | 81.4 | |
| METEOR2021.04 | 59 | 97.7 | 93.9 | 62 | 78.2 | |
| RefCLIP-Sreferences=52021.04 | 57.9 | 99.5 | 96.1 | 80.8 | 83.6 | |
| SPICE2021.04 | 56.9 | 96.3 | 87.1 | 66.4 | 76.7 | |
| METEORType=reference-only, Explainable=false2024.06 | 56.7 | 97.6 | 94.2 | 63.4 | 78 | |
| CLIP-S2022.05 | 56.5 | 99.3 | 96.4 | 70.4 | 80.7 | |
| CLIP-S (no refs)number of references=02021.04 | 56.5 | 99.3 | 96.4 | 70.4 | 80.7 | |
| CLIPScoreType=reference-free, Explainable=false2024.06 | 56.5 | 99.3 | 96.4 | 70.4 | 80.7 | |
| TIGEr2022.05 | 56 | 99.8 | 92.8 | 74.2 | 80.7 | |
| TIGErnumber of references=5, source=reported in prior work2021.04 | 56 | 99.8 | 92.8 | 74.2 | 80.7 | |
| TIGERReference-based=true2023.03 | 56 | 99.8 | 92.8 | 74.2 | 80.7 | |
| TIGErType=reference+image, Explainable=false2024.06 | 56 | 99.8 | 92.8 | 74.2 | 80.7 | |
| CLIP-SReference-based=false2023.03 | 55.9 | 99.3 | 96.5 | 72 | 80.9 | |
| ROUGE-L2021.04 | 55 | 95.3 | 93.1 | 58.7 | 75.5 | |
| BERT-S (ROBERTa-F)backbone=ROBERTa2021.04 | 54.4 | 96.1 | 94.3 | 56.4 | 75.3 | |
| CIDEr2021.04 | 53.7 | 98.1 | 90.8 | 63.7 | 76.6 | |
| BLEU-4Type=reference-only, Explainable=false2024.06 | 53 | 92.4 | 86.7 | 59.4 | 72.9 | |
| CIDErType=reference-only, Explainable=false2024.06 | 53 | 98 | 91.5 | 64.5 | 76.8 | |
| SPICEType=reference-only, Explainable=false2024.06 | 52.6 | 93.9 | 83.6 | 48.1 | 69.6 | |
| BLEU-42021.04 | 52.5 | 90.4 | 84.9 | 55.3 | 70.8 | |
| CLAIRType=reference-only, Explainable=true2024.06 | 52.4 | 99.5 | 89.8 | 73 | 78.7 | |
| length2022.05 | 51.7 | 52.3 | 63.6 | 49.6 | 54.3 | |
| lengthnumber of references=52021.04 | 51.7 | 52.3 | 63.6 | 49.6 | 54.3 | |
| length2023.03 | 51.7 | 52.3 | 63.6 | 49.6 | 54.3 | |
| ROUGE-LType=reference-only, Explainable=false2024.06 | 51.5 | 94.5 | 92.5 | 57.7 | 74.1 | |
| ViLBERTScore-F2022.05 | 49.9 | 99.6 | 93.1 | 75.8 | 79.6 | |
| ViLBERTScore-Fnumber of references=5, source=reported in prior work2021.04 | 49.9 | 99.6 | 93.1 | 75.8 | 79.6 | |
| ViLBERTScoreReference-based=true2023.03 | 49.9 | 99.6 | 93.1 | 75.8 | 79.6 | |
| VILBERTScore-FType=reference+image, Explainable=false2024.06 | 49.9 | 99.6 | 93.1 | 75.8 | 79.6 |