Image Captioning on DID-Bench GT-LLaVA (test)
39.93BLEU-1Patch Matters
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Patch MattersModel=Claude-3.5-Sonnet2025.04 | 39.93 | 22.14 | 11.87 | 6.65 | 4.27 | 20.78 | 20.69 | 20.65 | 45.06 | |
| ITModel=Claude-3.5-Sonnet2025.04 | 37.04 | 20.38 | 11.38 | 6.67 | 4.1 | 19.04 | 19.96 | 20.4 | 45.01 | |
| Patch MattersModel=GLM-4V-Plus2025.04 | 34.99 | 20.07 | 11.4 | 6.76 | 1.36 | 18.19 | 21.43 | 22.24 | 45.18 | |
| SynthesizedModel=Claude-3.5-Sonnet2025.04 | 30.4 | 16.58 | 8.99 | 5.14 | 2.2 | 17.31 | 20.36 | 20.29 | 44.53 | |
| Patch MattersModel=GPT-4o2025.04 | 27.06 | 15.43 | 8.75 | 5.19 | 2.12 | 16.52 | 20.12 | 22.64 | 44.91 | |
| GlobalModel=Claude-3.5-Sonnet2025.04 | 26.37 | 14.11 | 7.72 | 4.45 | 4.04 | 15.47 | 17.79 | 17.41 | 41.67 | |
| SynthesizedModel=GLM-4V-Plus2025.04 | 24.74 | 14.27 | 8.23 | 4.9 | 1.26 | 15.29 | 21.35 | 21.53 | 44.04 | |
| ITModel=GLM-4V-Plus2025.04 | 23.69 | 14.38 | 8.63 | 5.45 | 1.2 | 14.18 | 20.65 | 21.07 | 43.26 | |
| SynthesizedModel=GPT-4o2025.04 | 18.41 | 10.5 | 5.93 | 3.46 | 0 | 14.18 | 20.08 | 22.44 | 44.14 | |
| ITModel=GPT-4o2025.04 | 14.76 | 8.89 | 5.31 | 3.39 | 0.75 | 13.2 | 19.57 | 21.95 | 43.73 | |
| GlobalModel=GLM-4V-Plus2025.04 | 10.46 | 6.31 | 3.79 | 2.4 | 1.28 | 11.46 | 19.08 | 19.46 | 42.21 | |
| GlobalModel=GPT-4o2025.04 | 8.43 | 5.01 | 2.99 | 1.92 | 1.03 | 11.13 | 17.69 | 20.28 | 42.62 | |
| PoCaModel=Claude-3.5-Sonnet2025.04 | 4.29 | 2.36 | 1.26 | 0.71 | 0 | 8.79 | 13.98 | 16.28 | 39.5 | |
| PoCaModel=GLM-4V-Plus2025.04 | 2.03 | 1.19 | 0.67 | 0.4 | 0 | 7.72 | 13.44 | 16.62 | 39.11 | |
| PoCaModel=GPT-4o2025.04 | 0.66 | 0.39 | 0.22 | 0.14 | 0 | 6.57 | 11.9 | 16.01 | 37.94 |