Text-to-Image Generation on T2I-CompBench++
0.8677ColorQwen Image + Ours
Evaluation results
| Method | Links | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen Image + Oursbase_model=Qwen Image2026.01 | 0.8677 | 0.6348 | 0.7796 | 0.456 | 0.4202 | — | 0.3123 | — | — | 0.4104 | 0.7616 | 29.0212 | 6.2378 | — | — | — | — | |
| Janus-Pro + OSPOSize=7B2025.05 | 0.8567 | 0.6386 | 0.7727 | 0.3562 | 0.3926 | 0.5908 | 0.3161 | — | — | 0.4147 | — | — | — | — | — | — | — | |
| Qwen Image2026.01 | 0.8554 | 0.6358 | 0.765 | 0.3973 | 0.4077 | — | 0.311 | — | — | 0.3983 | 0.7406 | 28.8831 | 6.1925 | — | — | — | — | |
| ELDifffine-tuned=true, base_model=Qwen-Image2026.06 | 0.8525 | 0.6167 | 0.7617 | 0.4855 | 0.4761 | 0.7812 | 0.3153 | — | — | 0.4024 | — | — | — | — | — | — | — | |
| Prompt ReinjectionBackbone=Qwen-Image2026.02 | 0.8508 | 0.6138 | 0.7584 | 0.4594 | 0.4587 | — | 0.3166 | — | — | — | 0.7764 | — | — | — | — | — | — | |
| LLDMfine-tuned=true, base_model=Qwen-Image2026.06 | 0.8474 | 0.5948 | 0.7583 | 0.4569 | 0.4644 | 0.774 | 0.3134 | — | — | 0.395 | — | — | — | — | — | — | — | |
| Qwen-ImageMeta-TTRL=true2026.03 | 0.845 | 0.6242 | 0.7636 | 0.4659 | 0.4611 | 0.7677 | 0.3185 | — | — | 0.3848 | — | — | — | — | — | — | — | |
| TokenComfine-tuned=true, base_model=Qwen-Image2026.06 | 0.8444 | 0.5957 | 0.7641 | 0.4637 | 0.4686 | 0.7764 | 0.3131 | — | — | 0.3962 | — | — | — | — | — | — | — | |
| SD 3 (2B) + CTCALbase_model=SD 3 (2B)2026.03 | 0.8443 | 0.5968 | 0.7581 | 0.3476 | 0.4117 | 0.6292 | 0.7867 | — | — | 0.3814 | — | — | — | — | — | — | — | |
| Qwen ImageBackbone=Qwen-Image2026.02 | 0.8419 | 0.5978 | 0.7487 | 0.4536 | 0.4575 | — | 0.3163 | — | — | — | 0.754 | — | — | — | — | — | — | |
| Prompt ReinjectionBackbone=SD3-medium2026.02 | 0.8416 | 0.5965 | 0.7496 | 0.3044 | 0.4147 | — | 0.314 | — | — | — | 0.6056 | — | — | — | — | — | — | |
| Qwen-Imagestatus=Base model2026.06 | 0.8392 | 0.5941 | 0.7568 | 0.4512 | 0.4631 | 0.7705 | 0.3126 | — | — | 0.3944 | — | — | — | — | — | — | — | |
| SD3.5-M+Flow-GRPOModel=SD3.5-M, RL-Method=Flow-GRPO2025.05 | 0.8379 | 0.613 | 0.7236 | 0.5447 | 0.4471 | 0.6752 | 0.3195 | — | — | — | — | — | — | — | — | — | — | |
| Janus-Pro + OSPOSize=1B2025.05 | 0.8349 | 0.5763 | 0.7274 | 0.3077 | 0.4029 | 0.5653 | 0.3158 | — | — | 0.3935 | — | — | — | — | — | — | — | |
| OctoT2IType=Agentic2026.06 | 0.8344 | 0.627 | 0.7319 | 0.5272 | 0.4334 | 0.7508 | 0.96 | — | — | 0.43 | — | — | — | — | — | — | 0.6618 | |
| Prompt ReinjectionBackbone=SD3.5-large2026.02 | 0.832 | 0.6532 | 0.7789 | 0.3003 | 0.3967 | — | 0.3197 | — | — | — | 0.6398 | — | — | — | — | — | — | |
| Flow-OPDMethod Variant=Merge2026.05 | 0.8298 | 0.6292 | 0.7446 | — | 0.4565 | 0.6837 | 0.3163 | — | — | 0.3943 | — | — | — | — | — | — | — | |
| Qwen-ImageMeta-TTRL=false2026.03 | 0.828 | 0.5986 | 0.7451 | 0.443 | 0.4536 | 0.7582 | 0.3171 | — | — | 0.3838 | — | — | — | — | — | — | — | |
| CGPOTraining Dataset=GenEval-generated dataset2026.05 | 0.8271 | 0.617 | 0.7521 | 0.514 | 0.446 | 0.6955 | 0.3211 | — | — | — | — | — | — | — | — | — | — | |
| BAGELMeta-TTRL=true2026.03 | 0.8269 | 0.6194 | 0.7455 | 0.3808 | 0.4369 | 0.67 | 0.3128 | — | — | 0.3879 | — | — | — | — | — | — | — | |
| Flow-GRPOTraining Dataset=GenEval-generated dataset2026.05 | 0.8266 | 0.6235 | 0.7298 | 0.5044 | 0.4228 | 0.6664 | 0.3185 | — | — | — | — | — | — | — | — | — | — | |
| SD 3 (2B) + CORSbase_model=SD 3 (2B), source=reimplementation2026.03 | 0.8236 | 0.5833 | 0.7398 | 0.3232 | 0.4033 | 0.628 | 0.7708 | — | — | 0.3739 | — | — | — | — | — | — | — | |
| Cold Start2026.05 | 0.8173 | 0.6126 | 0.7342 | — | 0.4249 | 0.6458 | 0.3145 | — | — | 0.387 | — | — | — | — | — | — | — | |
| SpatialFusionCategory=Unified Generative Model2026.04 | 0.815 | 0.59 | 0.74 | 0.407 | 0.436 | 0.664 | — | — | — | — | — | — | — | — | — | — | — | |
| SD 3 (2B)2026.03 | 0.8132 | 0.5885 | 0.7334 | 0.32 | 0.4084 | 0.6174 | 0.7782 | — | — | 0.3771 | — | — | — | — | — | — | — | |
| SD3Category=Expertise Generative Model2026.04 | 0.813 | 0.589 | 0.733 | 0.32 | 0.408 | 0.617 | — | — | — | — | — | — | — | — | — | — | — | |
| Flow-GRPOType=Non-agentic2026.06 | 0.8119 | 0.6143 | 0.7194 | 0.5199 | 0.4373 | 0.6752 | 0.9133 | — | — | 0.3741 | — | — | — | — | — | — | 0.6332 | |
| BAGELCategory=Unified Generative Model2026.04 | 0.81 | 0.562 | 0.708 | 0.354 | 0.419 | 0.647 | — | — | — | — | — | — | — | — | — | — | — | |
| BAGELMeta-TTRL=false2026.03 | 0.8081 | 0.5794 | 0.7154 | 0.3403 | 0.3778 | 0.6552 | 0.3111 | — | — | 0.3778 | — | — | — | — | — | — | — | |
| SD3.5 + Oursbase_model=SD3.52026.01 | 0.8052 | 0.6744 | 0.8428 | 0.3647 | 0.3923 | — | 0.3169 | — | — | 0.4047 | 0.6088 | 28.9501 | 5.9401 | — | — | — | — | |
| Cold Start+GRPO2026.05 | 0.8031 | 0.5985 | 0.7409 | — | 0.4017 | 0.6269 | 0.3136 | — | — | 0.3842 | — | — | — | — | — | — | — | |
| SD3.5-MModel=SD3.5-M2025.05 | 0.7994 | 0.5669 | 0.7338 | 0.285 | 0.3739 | 0.5927 | 0.3146 | — | — | — | — | — | — | — | — | — | — | |
| SD3.5-M2026.05 | 0.7994 | 0.5669 | 0.7338 | — | 0.3739 | 0.5927 | 0.3146 | — | — | 0.38 | — | — | — | — | — | — | — | |
| SD3.5-MTraining Dataset=GenEval-generated dataset2026.05 | 0.7994 | 0.5669 | 0.7338 | 0.285 | 0.3739 | 0.5927 | 0.3146 | — | — | — | — | — | — | — | — | — | — | |
| GRPO-mix2026.05 | 0.7966 | 0.5803 | 0.7392 | — | 0.3681 | 0.6388 | 0.313 | — | — | 0.3677 | — | — | — | — | — | — | — | |
| Janus-Pro-7BMeta-TTRL=true2026.03 | 0.7933 | 0.501 | 0.6752 | 0.3246 | — | 0.5408 | 0.3135 | — | — | 0.3888 | — | — | — | — | — | — | — | |
| SD3Backbone=SD3-medium2026.02 | 0.7929 | 0.5704 | 0.7092 | 0.2913 | 0.4061 | — | 0.3114 | — | — | — | 0.605 | — | — | — | — | — | — | |
| EMU3Model=EMU32025.05 | 0.7913 | 0.5846 | 0.7422 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| OmniGen2Category=Unified Generative Model2026.04 | 0.788 | 0.564 | 0.723 | 0.388 | 0.414 | 0.644 | — | — | — | — | — | — | — | — | — | — | — | |
| Prompt ReinjectionBackbone=FLUX.1-Dev2026.02 | 0.7866 | 0.5172 | 0.6493 | 0.2779 | 0.4095 | — | 0.3079 | — | — | — | 0.6292 | — | — | — | — | — | — | |
| Janus-Pro + SUDERSize=7B2025.05 | 0.7824 | 0.5786 | 0.7292 | 0.2524 | — | — | 0.3141 | — | — | 0.3858 | — | — | — | — | — | — | — | |
| SD3.5Backbone=SD3.5-large2026.02 | 0.7809 | 0.6084 | 0.7296 | 0.2894 | 0.3858 | — | 0.3179 | — | — | — | 0.6368 | — | — | — | — | — | — | |
| FLUX + Oursbase_model=FLUX2026.01 | 0.7804 | 0.5482 | 0.698 | 0.328 | 0.39 | — | 0.3054 | — | — | 0.3691 | 0.6091 | 29.2267 | 6.411 | — | — | — | — | |
| DALL-E 3Category=Expertise Generative Model2026.04 | 0.779 | 0.621 | 0.704 | 0.287 | 0.374 | 0.593 | — | — | — | — | — | — | — | — | — | — | — | |
| DALL-E 3Size=–2025.05 | 0.7785 | 0.6205 | 0.7036 | 0.2865 | — | — | 0.3003 | — | — | 0.3773 | — | — | — | — | — | — | — | |
| DALL-E 32026.03 | 0.7785 | 0.6205 | 0.7036 | 0.2865 | 0.3744 | 0.5926 | 0.7853 | — | — | 0.3773 | — | — | — | — | — | — | — | |
| DALLE 3Type=Non-agentic2026.06 | 0.7785 | 0.6205 | 0.7036 | 0.2865 | 0.3744 | 0.5296 | 0.917 | — | — | 0.3771 | — | — | — | — | — | — | 0.5734 | |
| Janus-Pro + SUDERSize=1B2025.05 | 0.7765 | 0.5106 | 0.6767 | 0.2464 | — | — | 0.313 | — | — | 0.3657 | — | — | — | — | — | — | — | |
| Unitok-MLLMSize=7B2025.05 | 0.7745 | 0.5195 | 0.6431 | 0.2668 | 0.4088 | 0.5675 | 0.3131 | — | — | 0.3617 | — | — | — | — | — | — | — | |
| SANA-1.5Type=Non-agentic2026.06 | 0.7735 | 0.5571 | 0.6744 | 0.3706 | 0.41 | 0.6045 | 0.9233 | — | — | 0.3856 | — | — | — | — | — | — | 0.5874 | |
| FLUXBackbone=FLUX.1-Dev2026.02 | 0.7546 | 0.5086 | 0.6307 | 0.2765 | 0.4036 | — | 0.3069 | — | — | — | 0.6134 | — | — | — | — | — | — | |
| TACAr=642026.01 | 0.7535 | 0.5126 | 0.6522 | 0.3043 | 0.3814 | — | 0.3045 | — | — | 0.3619 | 0.5855 | 29.1525 | 6.3327 | — | — | — | — | |
| TACA2026.01 | 0.7434 | 0.5784 | 0.7444 | 0.2947 | 0.3839 | — | 0.3114 | — | — | 0.382 | 0.6029 | 29.3225 | 6.2297 | — | — | — | — | |
| FLUX.1-devCategory=Expertise Generative Model2026.04 | 0.741 | 0.572 | 0.692 | 0.286 | 0.387 | 0.619 | — | — | — | — | — | — | — | — | — | — | — | |
| FLUX.1 DevModel=FLUX.1 Dev2025.05 | 0.7407 | 0.5718 | 0.6922 | 0.2863 | 0.3866 | 0.6185 | 0.3127 | — | — | — | — | — | — | — | — | — | — | |
| FLUX.1Size=–2025.05 | 0.7407 | 0.5718 | 0.6922 | 0.2863 | — | — | 0.3127 | — | — | 0.3703 | — | — | — | — | — | — | — | |
| FLUX-schnell2026.03 | 0.7407 | 0.5718 | 0.6922 | 0.2863 | 0.3866 | 0.6185 | 0.7809 | — | — | 0.3703 | — | — | — | — | — | — | — | |
| SANA SprintType=Non-agentic2026.06 | 0.74 | 0.4987 | 0.6278 | 0.3548 | 0.405 | 0.5855 | 0.8867 | — | — | 0.3734 | — | — | — | — | — | — | 0.559 | |
| Janus-Pro + SILMMSize=7B2025.05 | 0.7394 | 0.4325 | 0.5796 | 0.2105 | 0.3572 | 0.5073 | 0.3113 | — | — | 0.3725 | — | — | — | — | — | — | — | |
| FLUX2026.01 | 0.7322 | 0.4908 | 0.649 | 0.2935 | 0.3739 | — | 0.3044 | — | — | 0.3597 | 0.5877 | 29.1586 | 6.3563 | — | — | — | — | |
| TACAr=162026.01 | 0.7296 | 0.4898 | 0.6549 | 0.2991 | 0.379 | — | 0.3034 | — | — | 0.3585 | 0.578 | 29.1375 | 6.3205 | — | — | — | — | |
| SD3.52026.01 | 0.7284 | 0.5592 | 0.7471 | 0.2866 | 0.3816 | — | 0.3118 | — | — | 0.3727 | 0.5969 | 29.2869 | 6.0978 | — | — | — | — | |
| SD 2.1 + CTCALbase_model=SD 2.12026.03 | 0.7233 | 0.5149 | 0.6754 | 0.2142 | 0.3862 | 0.5084 | 0.7723 | — | — | 0.3403 | — | — | — | — | — | — | — | |
| SD3.5-MType=Non-agentic2026.06 | 0.7119 | 0.5339 | 0.7262 | 0.2868 | 0.3554 | 0.57 | 0.8733 | — | — | 0.3418 | — | — | — | — | — | — | 0.5499 | |
| Diff-DPOBase=SDXL2026.04 | 0.6941 | 0.5311 | 0.6127 | 0.2153 | 0.3686 | 0.5304 | 0.3178 | — | — | 0.3525 | — | — | — | — | — | — | — | |
| Pixart-α-ft2026.03 | 0.669 | 0.4927 | 0.6477 | 0.2064 | 0.3901 | 0.5032 | 0.7747 | — | — | 0.3433 | — | — | — | — | — | — | — | |
| PixArt-alphaCategory=Expertise Generative Model2026.04 | 0.669 | 0.493 | 0.648 | 0.206 | 0.39 | 0.503 | — | — | — | — | — | — | — | — | — | — | — | |
| Semi-DPOBase=SDXL2026.04 | 0.6624 | 0.5079 | 0.5727 | 0.2133 | 0.3723 | 0.541 | 0.3154 | — | — | 0.3728 | — | — | — | — | — | — | — | |
| SD 2.1 + GORSbase_model=SD 2.1, source=original paper [17]2026.03 | 0.6603 | 0.4785 | 0.6287 | 0.1815 | 0.3572 | 0.483 | 0.7637 | — | — | 0.3328 | — | — | — | — | — | — | — | |
| SD 2.1 + GORSbase_model=SD 2.1, source=reimplementation2026.03 | 0.6426 | 0.4864 | 0.6319 | 0.1775 | 0.3475 | 0.4856 | 0.7621 | — | — | 0.3371 | — | — | — | — | — | — | — | |
| InPOBase=SDXL2026.04 | 0.6409 | 0.5067 | 0.572 | 0.2107 | 0.3671 | 0.5221 | 0.3129 | — | — | 0.3674 | — | — | — | — | — | — | — | |
| SD 2.1 + AEbase_model=SD 2.1, method=AE2026.03 | 0.64 | 0.4517 | 0.5963 | 0.1455 | 0.3222 | 0.4773 | 0.7593 | — | — | 0.3401 | — | — | — | — | — | — | — | |
| SD-XLSize=–2025.05 | 0.6369 | 0.5408 | 0.5637 | 0.2032 | — | — | 0.311 | — | — | 0.4091 | — | — | — | — | — | — | — | |
| Idea2ImgType=Agentic2026.06 | 0.6366 | 0.4596 | 0.5522 | 0.2799 | 0.3538 | 0.524 | 0.8933 | — | — | 0.349 | — | — | — | — | — | — | 0.506 | |
| UniWorld-V1Category=Unified Generative Model2026.04 | 0.618 | 0.335 | 0.474 | 0.275 | 0.405 | 0.553 | — | — | — | — | — | — | — | — | — | — | — | |
| SDXLType=Non-agentic2026.06 | 0.6111 | 0.4856 | 0.5201 | 0.1908 | 0.3558 | 0.5089 | 0.9067 | — | — | 0.3309 | — | — | — | — | — | — | 0.4887 | |
| Janus-Pro + SILMMSize=1B2025.05 | 0.6097 | 0.3164 | 0.4474 | 0.1539 | 0.2632 | 0.2826 | 0.3122 | — | — | 0.3679 | — | — | — | — | — | — | — | |
| MaPOBase=SDXL2026.04 | 0.609 | 0.5043 | 0.5485 | 0.1964 | 0.3473 | 0.5015 | 0.3154 | — | — | 0.3229 | — | — | — | — | — | — | — | |
| GenArtistType=Agentic2026.06 | 0.6089 | 0.4797 | 0.5241 | 0.192 | 0.3357 | 0.5026 | 0.8733 | — | — | 0.3291 | — | — | — | — | — | — | 0.4807 | |
| SD-XLCategory=Expertise Generative Model2026.04 | 0.588 | 0.469 | 0.53 | 0.213 | 0.357 | 0.499 | — | — | — | — | — | — | — | — | — | — | — | |
| SD XL2026.03 | 0.5879 | 0.4687 | 0.5299 | 0.2133 | 0.3566 | 0.4991 | 0.7673 | — | — | 0.3237 | — | — | — | — | — | — | — | |
| OriginalBase=SDXL2026.04 | 0.5833 | 0.4782 | 0.5211 | 0.1936 | 0.3319 | 0.4874 | 0.3137 | — | — | 0.3327 | — | — | — | — | — | — | — | |
| SD-TurboType=Non-agentic2026.06 | 0.5802 | 0.4485 | 0.5415 | 0.1345 | 0.3334 | 0.4979 | 0.8333 | — | — | 0.3506 | — | — | — | — | — | — | 0.465 | |
| Show-oSize=7B2025.05 | 0.56 | 0.41 | 0.46 | 0.2 | — | — | 0.3 | — | — | 0.29 | — | — | — | — | — | — | — | |
| Janus-ProSize=7B2025.05 | 0.5215 | 0.3272 | 0.405 | 0.1654 | 0.2679 | 0.4431 | 0.3109 | — | — | 0.3868 | — | — | — | — | — | — | — | |
| Janus-Pro-7BMeta-TTRL=false2026.03 | 0.5202 | 0.3272 | 0.4039 | 0.1573 | 0.2737 | 0.445 | 0.3127 | — | — | 0.3798 | — | — | — | — | — | — | — | |
| Janus-Pro-7BModel=Janus-Pro-7B2025.05 | 0.5145 | 0.3323 | 0.4069 | 0.1566 | 0.2753 | 0.4406 | 0.3137 | — | — | — | — | — | — | — | — | — | — | |
| SD 2.12026.03 | 0.5065 | 0.4221 | 0.4922 | 0.1342 | 0.323 | 0.4582 | 0.7567 | — | — | 0.3386 | — | — | — | — | — | — | — | |
| SD 2.1 + SDbase_model=SD 2.1, method=SD2026.03 | 0.499 | 0.4218 | 0.49 | 0.1386 | 0.3224 | 0.4557 | 0.756 | — | — | 0.3355 | — | — | — | — | — | — | — | |
| InPOBase=SD1.52026.04 | 0.482 | 0.424 | 0.493 | 0.159 | 0.341 | 0.468 | 0.314 | — | — | 0.319 | — | — | — | — | — | — | — | |
| ChatGenType=Agentic2026.06 | 0.4791 | 0.3628 | 0.376 | 0.1562 | 0.2963 | 0.4374 | 0.74 | — | — | 0.3157 | — | — | — | — | — | — | 0.3954 | |
| Semi-DPOBase=SD1.52026.04 | 0.471 | 0.433 | 0.493 | 0.183 | 0.34 | 0.481 | 0.31 | — | — | 0.32 | — | — | — | — | — | — | — | |
| Diffusion-KTOBase=SD1.52026.04 | 0.465 | 0.416 | 0.466 | 0.157 | 0.341 | 0.461 | 0.314 | — | — | 0.309 | — | — | — | — | — | — | — | |
| Diffusion-DPOBase=SD1.52026.04 | 0.409 | 0.366 | 0.425 | 0.134 | 0.312 | 0.454 | 0.312 | — | — | 0.304 | — | — | — | — | — | — | — | |
| SD 2.1 + CDbase_model=SD 2.1, method=CD2026.03 | 0.4063 | 0.3299 | 0.3645 | 0.08 | 0.2847 | 0.4272 | 0.6927 | — | — | 0.2898 | — | — | — | — | — | — | — | |
| OriginalBase=SD1.52026.04 | 0.378 | 0.362 | 0.417 | 0.123 | 0.297 | 0.449 | 0.31 | — | — | 0.3 | — | — | — | — | — | — | — | |
| SD 1.42026.03 | 0.3765 | 0.3576 | 0.4156 | 0.1246 | 0.303 | 0.4456 | 0.7487 | — | — | 0.308 | — | — | — | — | — | — | — | |
| SD1.5Type=Non-agentic2026.06 | 0.3591 | 0.372 | 0.3961 | 0.099 | 0.3139 | 0.4391 | 0.7866 | — | — | 0.3121 | — | — | — | — | — | — | 0.3847 | |
| Janus-ProSize=1B2025.05 | 0.3542 | 0.2291 | 0.2843 | 0.0756 | 0.2367 | 0.2714 | 0.2809 | — | — | 0.2693 | — | — | — | — | — | — | — | |
| DALL-E 22024.12 | — | — | — | — | — | — | — | 0.5863 | — | — | — | — | — | — | — | — | — |