Region Captioning on DLC-Bench
68Pos. ScoreGAR-8B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GAR-8BModel Category=Region MLLMs, Judging protocol=GPT-4o with extra cropped images2025.10 | 68 | 86 | 77 | |
| GAR-1BModel Category=Region MLLMs, Judging protocol=GPT-4o with extra cropped images2025.10 | 66.2 | 88 | 77.1 | |
| DAM-3BModel Category=Region MLLMs, Judging protocol=GPT-4o with extra cropped images, Evaluation checkpoint=official2025.10 | 61.8 | 83.4 | 72.6 | |
| DAMSize=3B2026.01 | 52.3 | 82.2 | 67.3 | |
| DAMSize=3B2026.06 | 52.3 | 82.2 | 67.3 | |
| GARSize=8B2026.06 | 50.9 | 84.6 | 67.8 | |
| GAR-8BModel Category=Region MLLMs, Judging protocol=text-only2025.10 | 50.2 | 84.6 | 67.4 | |
| PixelReferSize=7B2026.06 | 49.6 | 87 | 68.3 | |
| GAR-1BModel Category=Region MLLMs, Judging protocol=text-only2025.10 | 48.9 | 87 | 67.9 | |
| DAM-3BModel Category=Region MLLMs, Judging protocol=text-only, Evaluation checkpoint=official2025.10 | 47.2 | 81.8 | 64.5 | |
| o1Size=-2026.01 | 46.3 | 78.8 | 62.5 | |
| o1Model Category=Private General MLLMs, Judging protocol=text-only2025.10 | 46.3 | 78.8 | 62.5 | |
| Qwen3VL-SAMTokSize=4B2026.01 | 46.1 | 85.2 | 65.6 | |
| GPT-4oSize=-2026.01 | 43.4 | 79.6 | 61.5 | |
| GPT-4oModel Category=Private General MLLMs, Judging protocol=text-only2025.10 | 43.4 | 79.6 | 61.5 | |
| Gemini 2.5 ProSize=-2026.01 | 36.5 | 75.2 | 55.8 | |
| Gemini-2.5-ProModel Category=Private General MLLMs, Judging protocol=text-only2025.10 | 36.5 | 75.2 | 55.8 | |
| PerceptionDLMSize=8B2026.06 | 33.4 | 72.8 | 53.1 | |
| Gemini-2.5-ProSize=-2026.06 | 29.8 | 66 | 47.9 | |
| VP-SPHINXSize=13B2026.01 | 26.3 | 71.6 | 49 | |
| Gemini-3.1-ProSize=-2026.06 | 26.2 | 65.8 | 46 | |
| Claude 3.7 SonnetSize=-2026.01 | 21.8 | 50.4 | 36.1 | |
| Qwen2.5VLSize=7B2026.01 | 20.3 | 62.2 | 41.2 | |
| GPT-5.2Size=-2026.06 | 18 | 60.8 | 39.4 | |
| RegionGPT-7BModel Category=Region MLLMs, Judging protocol=text-only2025.10 | 13 | 41.4 | 27.2 | |
| VP-SPHINX-13BModel Category=Region MLLMs, Judging protocol=text-only2025.10 | 11.7 | 33.2 | 22.5 | |
| RegionGPTSize=7B2026.01 | 10.6 | 46.4 | 28.5 | |
| LLaDA-VSize=8B2026.06 | 10 | 39.2 | 24.6 | |
| SDAR-VLSize=8B2026.06 | 9.9 | 47.6 | 28.8 | |
| Dream-VLSize=7B2026.06 | 9.8 | 39.6 | 24.7 | |
| Ferret-7BModel Category=Region MLLMs, Judging protocol=text-only2025.10 | 6.4 | 38.4 | 22.4 | |
| OMG-LLaVASize=7B2026.01 | 5.6 | 32.6 | 19.1 | |
| Shikra-7BModel Category=Region MLLMs, Judging protocol=text-only2025.10 | 2.7 | 41.8 | 22.2 |