Image Captioning Evaluation on MCEval 1.0 (test)
87.8Real Style ScoreDISCODE
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| DISCODELVLM=true, finetuning-free=true, backbone=LLaVA-Next-72B, Evaluation Category=Reference-free2025.12 | 87.8 | 85.2 | 83.9 | 78.5 | 83.5 | 82.8 | 83.6 | |
| FLEUR (our implementation)LVLM=true, finetuning-free=true, backbone=LLaVA-Next-72B, Evaluation Category=Reference-free2025.12 | 86.9 | 84.3 | 83.1 | 76.3 | 82 | 82.3 | 82.5 | |
| G-VEval (GPT-4o)LVLM=true, finetuning-free=true, Evaluation Category=Reference-free2025.12 | 86 | 80.2 | 81.2 | 76.9 | 80.6 | 81 | 81 | |
| FLEURLVLM=true, finetuning-free=true, Evaluation Category=Reference-free2025.12 | 84.7 | 83.6 | 80.4 | 45.6 | 79.9 | 86 | 76.7 | |
| PolosLVLM=false, finetuning-free=false, Evaluation Category=Reference-based2025.12 | 81.3 | 75 | 77.6 | 76.8 | 74.5 | 69 | 75.7 | |
| PAC-SLVLM=false, finetuning-free=false, Evaluation Category=Reference-free2025.12 | 80.7 | 71.1 | 69.7 | 67.5 | 66.8 | 58.7 | 69.1 | |
| CLIP-SLVLM=true, finetuning-free=false, Evaluation Category=Reference-free2025.12 | 79.2 | 78 | 78.3 | 75.4 | 73.9 | 66.7 | 75.3 | |
| BERT-SLVLM=true, finetuning-free=false, Evaluation Category=Reference-based2025.12 | 68.5 | 73.8 | 74.3 | 72.6 | 67 | 58.6 | 69.1 | |
| METEORLVLM=false, finetuning-free=false, Evaluation Category=Reference-based2025.12 | 67.8 | 64.8 | 67.5 | 61.8 | 60.8 | 59.4 | 63.7 | |
| CIDErLVLM=false, finetuning-free=false, Evaluation Category=Reference-based2025.12 | 66.7 | 64.5 | 68.7 | 62.8 | 64.5 | 60.2 | 64.6 | |
| BLEU-4LVLM=false, finetuning-free=false, Evaluation Category=Reference-based2025.12 | 59.3 | 58.1 | 61.5 | 55.7 | 54.9 | 53.2 | 57.1 | |
| ROUGELVLM=false, finetuning-free=false, Evaluation Category=Reference-based2025.12 | 57.9 | 56.9 | 59.5 | 54.5 | 54.4 | 50.6 | 55.6 |