Image Captioning Evaluation on MMHE (test)
51.3Fluency ScoreITIScore
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ITIScoreZero-shot=true2026.04 | 51.3 | 50.7 | 52.6 | |
| Gemini-3.0-FlashZero-shot=true2026.04 | 48.9 | 45.6 | 50.8 | |
| ChatGPT-5Zero-shot=true2026.04 | 45.6 | 47.3 | 52.4 | |
| ChatGPT-4oZero-shot=true2026.04 | 45.2 | 41.5 | 47.2 | |
| Gemini-2.5-FlashZero-shot=true2026.04 | 43.1 | 39.4 | 45 | |
| InternVL3.5 (7B)Zero-shot=true2026.04 | 39.7 | 36.2 | 41.5 | |
| Qwen3-VL (7B)Zero-shot=true2026.04 | 36.8 | 33.5 | 38.2 | |
| FLEURZero-shot=true2026.04 | 27.1 | 35.3 | 24.5 | |
| PAC-SZero-shot=true2026.04 | 26.4 | 27.3 | 10.6 | |
| CIDErZero-shot=true2026.04 | 14.4 | 9.8 | 9.6 | |
| BERT-SZero-shot=true2026.04 | 11.2 | 12.4 | 13.2 | |
| METEORZero-shot=true2026.04 | 9.1 | 9.8 | 6.6 | |
| BLEUZero-shot=true2026.04 | 8.8 | 8.7 | 10.7 | |
| ROUGEZero-shot=true2026.04 | 8.5 | 7.4 | 11.6 | |
| CLIP-SZero-shot=true2026.04 | 6.2 | 13.4 | 5.4 |