Graphic Layout Generation on Crello (test)
92.56Char-FVFLM
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| VFLMCategory=Ours2026.03 | 92.56 | 0.0025 | 0.0022 | 14.8063 | 0.5548 | 8.826 | 8.5957 | 7.7267 | 8.2964 | 8.3562 | |
| GPT-4oCategory=MLLM2026.03 | 91.01 | 0.0017 | 0.0036 | 19.9216 | 0.4427 | 8.9612 | 7.9949 | 7.5237 | 7.9618 | 8.1104 | |
| IGDCategory=Layout2026.03 | 88.53 | 0.0128 | 0.0182 | 20.2092 | 0.3959 | 8.3001 | 7.5402 | 6.9126 | 7.4004 | 7.5383 | |
| GPT-4oCategory=Image Edit2026.03 | 87.74 | — | — | — | 0.5849 | 8.8438 | 9.0127 | 8.8051 | 9.0069 | 8.9171 | |
| VFLM-step1Category=Ours2026.03 | 87.74 | 0.0046 | 0.0061 | 19.5917 | 0.4392 | 8.2334 | 7.9055 | 7.2046 | 7.6543 | 7.7494 | |
| Doubao-Seed-1.6Category=MLLM2026.03 | 87.58 | 0.0051 | 0.0192 | 21.5918 | 0.4876 | 8.8927 | 8.2174 | 7.6658 | 8.2569 | 8.2582 | |
| Claude3.7Category=MLLM2026.03 | 86.1 | 0.0058 | 0.0205 | 21.0798 | 0.588 | 8.9645 | 8.3805 | 7.8999 | 8.4507 | 8.4239 | |
| Qwen-Image-EditCategory=Image Edit2026.03 | 83.26 | — | — | — | 0.3671 | 5.7509 | 7.2808 | 6.0635 | 5.9903 | 6.2714 | |
| Qwen2.5-VL-72BCategory=MLLM2026.03 | 81.15 | 0.0044 | 0.0619 | 24.6138 | 0.2359 | 7.7332 | 7.4732 | 6.5589 | 6.5405 | 7.0764 | |
| Qwen2.5-VL-7BCategory=MLLM2026.03 | 76.2 | 0.0028 | 0.0256 | 30.9031 | 0.2116 | 7.6289 | 6.284 | 5.5726 | 5.5813 | 6.2667 | |
| OpenCOLECategory=Layout2026.03 | 64.11 | 1.1902 | 0.0429 | 31.5831 | 0.3345 | 6.9777 | 7.3864 | 6.4068 | 6.5319 | 6.8257 | |
| FLUX KontextCategory=Image Edit2026.03 | 55.58 | — | — | — | -0.0834 | 3.2447 | 6.6992 | 4.5005 | 4.1499 | 4.6486 |