Text-to-Image Generation on T2I-ReasonBench
75.7Idiom AccuracyGPT-4o
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| GPT-4oType=proprietary2026.01 | 75.7 | 94.5 | 86.9 | 97.6 | 77.5 | 96.6 | 74.7 | 94.3 | 78.7 | 95.8 | |
| gpt-image-1Types=Gen2025.11 | 75.7 | 94.5 | 86.9 | 97.6 | 77.5 | 96.6 | 74.7 | 94.3 | 78.7 | 95.8 | |
| GPT-4oType=Proprietary2026.05 | 75.7 | 94.5 | 86.9 | 97.6 | 77.5 | 96.6 | 74.7 | 94.3 | 78.7 | 95.8 | |
| Generation NavigatorType=Agent2026.05 | 74.96 | 94.79 | 89.71 | 94.62 | 73.9 | 97.08 | 77.66 | 92.83 | 79.06 | 94.83 | |
| StruVisBase Model=Qwen3-VL-8B, Generator=Flux-dev-12026.03 | 70.15 | 92.99 | 75.22 | 84.75 | 76.74 | 97.33 | 72.18 | 92.12 | 73.57 | 91.8 | |
| StruVisType=Agent2026.05 | 70.15 | 92.99 | 75.22 | 84.75 | 76.74 | 97.33 | 72.18 | 92.12 | 73.57 | 91.8 | |
| StruVisBase Model=Qwen2.5-VL-7B, Generator=Flux-dev-12026.03 | 69.85 | 93.08 | 74.64 | 84.75 | 76.3 | 96.83 | 72.09 | 93.29 | 73.22 | 91.99 | |
| InterleavedBase Model=Qwen3-VL-8B, Generator=Flux-dev-12026.03 | 61.92 | 92.31 | 74.92 | 84.71 | 70.56 | 95.04 | 68.46 | 91.75 | 68.97 | 90.95 | |
| InterleavedBase Model=Qwen2.5-VL-7B, Generator=Flux-dev-12026.03 | 61.46 | 91.79 | 72.9 | 84.54 | 63.55 | 95.98 | 67.48 | 91.08 | 66.35 | 90.85 | |
| Text-OnlyBase Model=Qwen3-VL-8B, Generator=Flux-dev-12026.03 | 61.43 | 91.08 | 74.03 | 82.96 | 62.03 | 94.48 | 62.4 | 88.25 | 64.97 | 89.19 | |
| W/O.Base Model=Qwen3-VL-8B, Generator=Flux-dev-12026.03 | 60.66 | 90.77 | 71.35 | 82.71 | 59.25 | 94.13 | 61.77 | 90.42 | 63.26 | 89.51 | |
| Ours (w/o GRPO)Type=diffusion2026.01 | 59.5 | 90.4 | 71.5 | 87.1 | 61.29 | 93.9 | 72.2 | 91.8 | 66.1 | 90.8 | |
| OursType=diffusion2026.01 | 58.5 | 90.6 | 75.2 | 89.5 | 68.8 | 95.2 | 72.9 | 93.5 | 68.3 | 92.2 | |
| Think-then-GenerateType=Agent2026.05 | 58.5 | 90.6 | 75.2 | 89.5 | 68.8 | 95.2 | 72.9 | 93.5 | 68.3 | 92.2 | |
| FLUX.2-Klein-9BType=Open-source2026.05 | 55.35 | 93.83 | 43.21 | 77.02 | 57.78 | 84.29 | 74.44 | 76.12 | 57.7 | 82.82 | |
| Gemini-2.0Type=proprietary2026.01 | 52.4 | 87.8 | 73 | 83.3 | 67 | 94.3 | 66.7 | 89.3 | 64.8 | 88.7 | |
| Gemini-2.0Types=Unified2025.11 | 52.4 | 87.8 | 73 | 83.3 | 67 | 94.3 | 66.7 | 89.3 | 64.8 | 88.7 | |
| Gemini-2.0Type=Proprietary2026.05 | 52.4 | 87.8 | 73 | 83.3 | 67 | 94.3 | 66.7 | 89.3 | 64.8 | 88.7 | |
| Text-OnlyBase Model=Qwen2.5-VL-7B, Generator=Flux-dev-12026.03 | 51.71 | 90.31 | 72.9 | 84.54 | 61.16 | 95.9 | 63.87 | 89.75 | 62.41 | 90.12 | |
| Ours (w/o SFT+GRPO)Type=diffusion2026.01 | 51.7 | 86.3 | 71.7 | 83.8 | 57.3 | 92.8 | 62.8 | 87.6 | 60.9 | 86.6 | |
| UniCoTType=unified2026.01 | 49 | 84.2 | 58.1 | 92.3 | 73.5 | 92.9 | 51.9 | 71.7 | 58.1 | 85.3 | |
| UniCoTType=Open-source2026.05 | 49 | 84.2 | 58.1 | 92.3 | 73.5 | 92.9 | 51.9 | 71.7 | 58.1 | 85.3 | |
| Qwen-ImageType=diffusion2026.01 | 48.1 | 84.3 | 66.5 | 85.8 | 57.1 | 84.7 | 59.5 | 85.3 | 57.8 | 87.5 | |
| Qwen-ImageType=Open-source2026.05 | 48.1 | 84.3 | 66.5 | 85.8 | 57.1 | 84.7 | 59.5 | 85.3 | 57.8 | 87.5 | |
| W/O.Base Model=Qwen2.5-VL-7B, Generator=Flux-dev-12026.03 | 46.32 | 90.58 | 64.95 | 78.5 | 59.96 | 94.48 | 58.71 | 88.33 | 57.48 | 87.97 | |
| Bagel w/CoTType=unified2026.01 | 44.6 | 84.3 | 44 | 73.7 | 52.4 | 91.6 | 57.7 | 88.3 | 49.7 | 84.5 | |
| Self-RewriteTypes=Bagel, Backbone=Bagel2025.11 | 44.6 | 84.3 | 44 | 73.7 | 52.4 | 91.6 | 57.7 | 88.3 | 49.7 | 84.5 | |
| Bagel w/CoTType=Open-source2026.05 | 44.6 | 84.3 | 44 | 73.7 | 52.4 | 91.6 | 57.7 | 88.3 | 49.7 | 84.5 | |
| playground-v2.5Types=Gen2025.11 | 43.9 | 87.8 | 38.5 | 72.1 | 48.4 | 92.4 | 50.8 | 83.3 | 45.4 | 83.9 | |
| FLUX.1-schnellTypes=Gen2025.11 | 40.9 | 83.1 | 65.1 | 74.5 | 44.8 | 91.5 | 50.7 | 83 | 50.4 | 83 | |
| FLUX.1-devType=diffusion2026.01 | 39.1 | 83.4 | 56.9 | 76.5 | 45.1 | 90.6 | 46.7 | 80.9 | 47 | 82.8 | |
| FLUX.1-devTypes=Gen2025.11 | 39.1 | 83.4 | 56.9 | 76.5 | 45.1 | 90.6 | 46.7 | 80.9 | 47 | 82.8 | |
| ImAgentTypes=Bagel, Backbone=Bagel2025.11 | 37.7 | 90 | 54.2 | 79.1 | 52.6 | 96.6 | 61.2 | 90.3 | 51.4 | 89 | |
| SD-3-MediumTypes=Gen2025.11 | 35.9 | 81.4 | 60.9 | 71.3 | 42.4 | 90.1 | 50.9 | 81.7 | 47.5 | 81.1 | |
| SD-3.5-largeType=diffusion2026.01 | 35.6 | 85.3 | 62.2 | 75.4 | 46.6 | 92.6 | 52.9 | 84.5 | 49.3 | 84.4 | |
| SD-3.5-LargeTypes=Gen2025.11 | 35.6 | 85.3 | 62.2 | 75.4 | 46.6 | 92.6 | 52.9 | 84.5 | 49.3 | 84.4 | |
| SD-3.5-largeType=Open-source2026.05 | 35.6 | 85.3 | 62.2 | 75.4 | 46.6 | 92.6 | 52.9 | 84.5 | 49.3 | 84.4 | |
| SD-3.5-mediumType=diffusion2026.01 | 34.4 | 80.6 | 58 | 70.1 | 44.8 | 92.1 | 49.9 | 83 | 46.8 | 81.4 | |
| SD-3.5-MediumTypes=Gen2025.11 | 34.4 | 80.6 | 58 | 70.1 | 44.8 | 92.1 | 49.9 | 83 | 46.8 | 81.4 | |
| Emu3Types=Unified2025.11 | 33.1 | 82.9 | 33.7 | 68.7 | 33.8 | 85.2 | 40.1 | 77 | 35.2 | 78.5 | |
| show-oTypes=Unified2025.11 | 33.1 | 82.5 | 35.3 | 80.3 | 34.9 | 87.4 | 41.6 | 76.6 | 36.2 | 81.7 | |
| VanillaTypes=Bagel, Backbone=Bagel2025.11 | 30.2 | 85.7 | 36.6 | 68.4 | 45 | 94.7 | 54.4 | 87.5 | 41.6 | 84.1 | |
| GoTTypes=Unified2025.11 | 29.7 | 76.4 | 30.6 | 70.7 | 31 | 86.2 | 36.8 | 76.3 | 32 | 77.4 | |
| ImAgentTypes=Janus-Pro-7B, Backbone=Janus-Pro-7B2025.11 | 27.9 | 86 | 35.3 | 68.8 | 40.7 | 89.7 | 51.2 | 84.2 | 38.8 | 82.2 | |
| Janus-Pro-7BType=unified2026.01 | 25.5 | 78 | 37.2 | 70.9 | 38.5 | 87.6 | 44.9 | 77.8 | 36.5 | 78.6 | |
| VanillaTypes=Janus-Pro-7B, Backbone=Janus-Pro-7B2025.11 | 25.5 | 78 | 37.2 | 70.9 | 38.5 | 87.6 | 44.9 | 77.8 | 36.5 | 78.6 | |
| HunyuanImage-3.0Type=unified2026.01 | 25.4 | 80.2 | 54.2 | 80.9 | 52.3 | 92.2 | 56.8 | 84.4 | 47.2 | 84.4 | |
| HunyuanImage-3.0Type=Open-source2026.05 | 25.4 | 80.2 | 54.2 | 80.9 | 52.3 | 92.2 | 56.8 | 84.4 | 47.2 | 84.4 | |
| Self-RewriteTypes=Janus-Pro-7B, Backbone=Janus-Pro-7B2025.11 | 11.9 | 74.6 | 9.2 | 49.3 | 12 | 74.3 | 14 | 59.3 | 11.1 | 63.3 |