Graphic Layout Generation on DESIGNERINTENTION (test)
96.63Char-FVFLM
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| VFLMCategory=Ours2026.03 | 96.63 | 0.24 | 0.08 | 12.1167 | 56.88 | 9.5569 | 8.4511 | 7.9301 | 8.513 | 8.6128 | |
| GPT-4oCategory=MLLM2026.03 | 95.63 | 0.15 | 1.4 | 18.7249 | 50.72 | 9.518 | 8.2725 | 8.02 | 8.482 | 8.5731 | |
| VFLM-step1Category=Ours2026.03 | 94.15 | 0.33 | 0.23 | 14.123 | 52.85 | 9.402 | 8.1924 | 7.864 | 8.326 | 8.4461 | |
| IGDCategory=Layout2026.03 | 92.83 | 1.15 | 0.65 | 14.5905 | 53.49 | 8.8112 | 7.7505 | 7.4449 | 7.8677 | 7.9686 | |
| Doubao-Seed-1.6Category=MLLM2026.03 | 89.17 | 0.46 | 2.22 | 15.747 | 51.03 | 9.144 | 8.002 | 7.74 | 8.296 | 8.2955 | |
| GPT-4oCategory=Image Edit2026.03 | 88.32 | — | — | — | 62.78 | 9.5231 | 8.9287 | 9.0126 | 9.2558 | 9.18 | |
| Claude3.7Category=MLLM2026.03 | 87.53 | 0.7 | 6.01 | 15.0869 | 64.65 | 9.5815 | 8.5473 | 8.2052 | 8.8229 | 8.7892 | |
| Qwen-Image-EditCategory=Image Edit2026.03 | 85.18 | — | — | — | 59.95 | 7.1626 | 7.7435 | 7.2625 | 7.1403 | 7.3272 | |
| OpenCOLECategory=Layout2026.03 | 73.08 | 68.48 | 4.08 | 20.2853 | 46.84 | 8.4738 | 7.3488 | 6.9516 | 7.4435 | 7.5544 | |
| Qwen2.5-VL-7BCategory=MLLM2026.03 | 66.94 | 0.11 | 6.89 | 19.1119 | 20.18 | 7.3688 | 6.1285 | 5.6576 | 5.4498 | 6.1512 | |
| Qwen2.5-VL-72BCategory=MLLM2026.03 | 54.75 | 0.69 | 16.49 | 17.8489 | 31.04 | 4.1891 | 7.7565 | 6.8813 | 4.497 | 5.831 | |
| FLUX KontextCategory=Image Edit2026.03 | 54.12 | — | — | — | 44.26 | 4.3908 | 7.2806 | 5.4208 | 5.1503 | 5.5606 |