Image Captioning Evaluation on Pascal-50S
87.8AccuracyDENEB
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| DENEBBackbone=ViT-L, Metric Category=Reference-based2025.12 | 87.8 | — | — | — | — | — | — | |
| PolosMetric Category=Reference-based2025.12 | 86.5 | — | — | — | — | — | — | |
| InfoMetIC+Metric Category=Reference-free2025.12 | 86.5 | — | — | — | — | — | — | |
| PolosReference protocol=Reference-based2024.12 | 86.5 | — | — | — | — | — | — | |
| InfoMetIC+Reference protocol=Reference-free2024.12 | 86.5 | — | — | — | — | — | — | |
| HICE-SMetric Category=Reference-free2025.12 | 86.1 | — | — | — | — | — | — | |
| CAMScoreMetric Category=Reference-free2025.12 | 85.8 | — | — | — | — | — | — | |
| RefFLEURReference protocol=Reference-based2024.12 | 85.5 | — | — | — | — | — | — | |
| InfoMetICReference protocol=Reference-free2024.12 | 85.3 | — | — | — | — | — | — | |
| UMICMetric Category=Reference-free2025.12 | 85.1 | — | — | — | — | — | — | |
| UMICReference protocol=Reference-free2024.12 | 85.1 | — | — | — | — | — | — | |
| RefPAC-S++Backbone=ViT-L, Metric Category=Reference-based2025.12 | 84.7 | — | — | — | — | — | — | |
| DISCODE-LVLVLM=true, Backbone=LLaVA-Next-72B, Metric Category=Reference-free2025.12 | 84.5 | — | — | — | — | — | — | |
| FLEUR-LVLVLM=true, Backbone=LLaVA-Next-72B, Metric Category=Reference-free2025.12 | 83.8 | — | — | — | — | — | — | |
| DISCODE-INLVLM=true, Backbone=InternVL-2.5-78B, Metric Category=Reference-free2025.12 | 83.5 | — | — | — | — | — | — | |
| RefCLIP-SMetric Category=Reference-based2025.12 | 83.3 | — | — | — | — | — | — | |
| FLEURLVLM=true, Metric Category=Reference-free2025.12 | 83.2 | — | — | — | — | — | — | |
| FLEURReference protocol=Reference-free2024.12 | 83.2 | — | — | — | — | — | — | |
| RefCLIP-ScoreReference protocol=Reference-based2024.12 | 83.1 | — | — | — | — | — | — | |
| HiFi-ScoreMetric Category=Reference-free2025.12 | 83 | — | — | — | — | — | — | |
| BRIDGEBackbone=ViT-L, Metric Category=Reference-free2025.12 | 82.9 | — | — | — | — | — | — | |
| GPT-FLEURReference protocol=Reference-free2024.12 | 82.6 | — | — | — | — | — | — | |
| PAC-S++Backbone=ViT-L, Metric Category=Reference-free2025.12 | 82.4 | — | — | — | — | — | — | |
| HarmonicEvalReference protocol=Reference-free2024.12 | 82.4 | — | — | — | — | — | — | |
| G-VEvalLVLM=true, Backbone=GPT-4o, Metric Category=Reference-free2025.12 | 82.3 | — | — | — | — | — | — | |
| G-VEvalReference protocol=Reference-free2024.12 | 82.3 | — | — | — | — | — | — | |
| FAIEr-4Reference protocol=Reference-based2024.12 | 81.4 | — | — | — | — | — | — | |
| METEORMetric Category=Reference-based2025.12 | 81.1 | — | — | — | — | — | — | |
| CLIP-SMetric Category=Reference-free2025.12 | 80.9 | — | — | — | — | — | — | |
| FLEUR-INLVLM=true, Backbone=InternVL-2.5-78B, Metric Category=Reference-free2025.12 | 80.8 | — | — | — | — | — | — | |
| TIGErReference protocol=Reference-based2024.12 | 80.7 | — | — | — | — | — | — | |
| CLIP-SReference protocol=Reference-free2024.12 | 80.7 | — | — | — | — | — | — | |
| CIDErMetric Category=Reference-based2025.12 | 80.1 | — | — | — | — | — | — | |
| ViLBERTS-FReference protocol=Reference-based2024.12 | 79.6 | — | — | — | — | — | — | |
| BERT-SReference protocol=Reference-based2024.12 | 79.1 | — | — | — | — | — | — | |
| SPICEMetric Category=Reference-based2025.12 | 78.7 | — | — | — | — | — | — | |
| ROUGEMetric Category=Reference-based2025.12 | 78 | — | — | — | — | — | — | |
| METEORReference protocol=Reference-based2024.12 | 78 | — | — | — | — | — | — | |
| CIDErReference protocol=Reference-based2024.12 | 76.8 | — | — | — | — | — | — | |
| ROUGEReference protocol=Reference-based2024.12 | 74.1 | — | — | — | — | — | — | |
| BLEU-4Metric Category=Reference-based2025.12 | 74 | — | — | — | — | — | — | |
| BLEUReference protocol=Reference-based2024.12 | 72.9 | — | — | — | — | — | — | |
| SPICEReference protocol=Reference-based2024.12 | 69.6 | — | — | — | — | — | — | |
| InfoCLIPReference protocol=Reference-free2024.12 | 64.1 | — | — | — | — | — | — | |
| BERT-SType=w/ ref2023.05 | — | 54.4 | 96.1 | 94.3 | 56.4 | 75.3 | — | |
| BERT-SFF=true2025.12 | — | 65.4 | 96.2 | 93.3 | 61.4 | 79.1 | — | |
| BERT-S++Type=w/ ref2023.05 | — | 65.4 | 98.1 | 96.4 | 60.3 | 80.1 | — | |
| BERT-S++FF=true2025.12 | — | 65.4 | 98.1 | 96.4 | 60.3 | 80.1 | — | |
| BLEU-1FF=false2025.12 | — | 64.6 | 95.2 | 91.2 | 60.7 | 77.9 | — | |
| BLEU-4Type=w/ ref2023.05 | — | 52.5 | 90.4 | 63 | 42.3 | 55.8 | — | |
| BLEU-4FF=false2025.12 | — | 60.3 | 93.1 | 85.7 | 57 | 74 | — | |
| CIDErType=w/ ref2023.05 | — | 53.7 | 98.1 | 90.8 | 63.7 | 76.6 | — | |
| CIDErFF=false2025.12 | — | 66.5 | 97.9 | 90.7 | 65.2 | 80.1 | — | |
| CLAIRFF=true2025.12 | — | 52.4 | 99.5 | 89.8 | 73 | 78.7 | — | |
| CLIP-SType=w/o ref2023.05 | — | 60.4 | 99.4 | 97.8 | 77.1 | 83.7 | — | |
| CLIP-StuneType=w/o ref2023.05 | — | 61 | 99.5 | 95.9 | 82 | 84.6 | — | |
| CLIPScorePerturbation=Vertical Flip2026.05 | — | — | — | — | — | — | 7.4 | |
| DENEB (ViT-L)FF=false2025.12 | — | 76.1 | 99.7 | 97.4 | 77.9 | 87.8 | — | |
| FAIEr-4Type=w/ ref2023.05 | — | 59.7 | 99.9 | 92.7 | 73.4 | 81.4 | — | |
| FLEURPerturbation=Vertical Flip2026.05 | — | — | — | — | — | — | 3.9 | |
| InfoCLIPType=w/o ref2023.05 | — | 37.3 | 87.3 | 58.9 | 72.9 | 64.1 | — | |
| InfoCLIPtuneType=w/o ref2023.05 | — | 37.3 | 92.5 | 62.7 | 74.7 | 66.8 | — | |
| InfoMetICType=w/o ref2023.05 | — | 69 | 99.8 | 94 | 78.3 | 85.3 | — | |
| InfoMetIC+Type=w/o ref2023.05 | — | 69.9 | 99.7 | 96.8 | 79.6 | 86.5 | — | |
| JudgePerturbation=Vertical Flip2026.05 | — | — | — | — | — | — | 2.5 | |
| METEORType=w/ ref2023.05 | — | 59 | 97.7 | 93.9 | 62 | 78.2 | — | |
| METEORFF=false2025.12 | — | 66 | 97.7 | 94 | 66.6 | 81.1 | — | |
| MIDFF=true2025.12 | — | 67 | 99.7 | 97.4 | 76.8 | 85.2 | — | |
| PAC-SPerturbation=Vertical Flip2026.05 | — | — | — | — | — | — | 6.5 | |
| PolosFF=false2025.12 | — | 70 | 99.6 | 97.4 | 79 | 86.5 | — | |
| RefCLIP-SType=w/ ref2023.05 | — | 57.9 | 99.5 | 96.1 | 80.8 | 83.6 | — | |
| RefCLIP-SFF=true2025.12 | — | 64.9 | 99.5 | 95.5 | 73.3 | 83.3 | — | |
| RefDISCODE-INFF=true2025.12 | — | 68 | 99.7 | 97.7 | 79.7 | 86.3 | — | |
| RefDISCODE-LVFF=true2025.12 | — | 70.6 | 99.8 | 98.6 | 82.1 | 87.8 | — | |
| RefFLEURFF=true2025.12 | — | 68 | 99.8 | 98 | 76.1 | 85.5 | — | |
| RefPAC-S2025.12 | — | 67.7 | 99.6 | 96 | 75.6 | 84.7 | — | |
| RefPAC-S++ViT-B2025.12 | — | 67.2 | 99.6 | 96.2 | 74.2 | 84.5 | — | |
| RefPAC-S++ViT-LFF=false2025.12 | — | — | — | — | — | 84.7 | — | |
| ROUGEFF=false2025.12 | — | 63.9 | 95 | 92.3 | 60.9 | 78 | — | |
| ROUGE-LType=w/ ref2023.05 | — | 55 | 95.3 | 93.1 | 58.7 | 75.5 | — | |
| SPICEType=w/ ref2023.05 | — | 56.9 | 96.3 | 87.1 | 66.4 | 76.7 | — | |
| SPICEFF=false2025.12 | — | 63.6 | 96.3 | 86.7 | 68.3 | 78.7 | — | |
| TIGErType=w/ ref2023.05 | — | 56 | 99.8 | 92.8 | 74.2 | 80.7 | — | |
| TIGErFF=true2025.12 | — | 56 | 99.8 | 92.8 | 74.2 | 80.7 | — | |
| UMICType=w/o ref2023.05 | — | 66.1 | 99.8 | 98.1 | 76.2 | 85.1 | — | |
| UMICPerturbation=Vertical Flip2026.05 | — | — | — | — | — | — | 4.9 | |
| ViLBERTScoreFF=true2025.12 | — | 49.9 | 99.6 | 93.1 | 75.8 | 79.6 | — | |
| ViLBERTScore-FType=w/ ref2023.05 | — | 49.9 | 99.6 | 93.1 | 75.8 | 79.6 | — |