Image Generation on GenEval (Detailed Compositional Metrics)
95Overall GenEval ScoreOmniGen2
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| OmniGen2Params=3B + 4B*2025.06 | 95 | — | — | — | — | — | — | |
| Qwen-ImageParams=-2025.06 | 91 | — | — | — | — | — | — | |
| TunaSize=7B2026.04 | 90 | 100 | 97 | 81 | 91 | 88 | 83 | |
| MogaoSize=7B2026.04 | 89 | 100 | 97 | 83 | 93 | 84 | 80 | |
| BAGELParams=7B + 7B*, LLM rewriter=true2025.06 | 88 | — | — | — | — | — | — | |
| BAGELSize=14B, LLM rewriters=true2026.04 | 88 | 98 | 95 | 84 | 95 | 78 | 77 | |
| Tuna-RSize=7B2026.04 | 88 | 100 | 95 | 82 | 89 | 86 | 79 | |
| BAGEL# Params=14B, LLM rewriters=true2026.06 | 88 | — | 95 | — | — | 78 | — | |
| HYDRA-X# Params=7B, LLM rewriters=false2026.06 | 88 | — | 95 | — | — | 84 | — | |
| LongCat-ImageParam.=6B, Resolution=1024 x 10242026.03 | 87 | 99 | 98 | 86 | 86 | 75 | 73 | |
| LongCat-ImageSize=6B2026.04 | 87 | 99 | 98 | 86 | 86 | 75 | 73 | |
| Qwen-ImageSize=20B2026.04 | 87 | 99 | 92 | 89 | 88 | 76 | 77 | |
| HBridgeSize=7B, LLM rewriters=true2026.04 | 87 | 100 | 96 | 80 | 94 | 77 | 78 | |
| Tuna-2Size=7B2026.04 | 87 | 99 | 96 | 80 | 91 | 84 | 76 | |
| BLIP3o-8B (Ours)Baseline=BLIP3o-8B, Params=8B2026.06 | 87 | 99 | 93 | 71 | 94 | 90 | 75 | |
| OmniGen2Size=7B, LLM rewriters=true2026.04 | 86 | 99 | 96 | 74 | 98 | 71 | 75 | |
| Ming-UniVisionSize=16B2026.04 | 85 | 100 | 93 | 59 | 93 | 92 | 70 | |
| Ming-UniVision# Params=16B, LLM rewriters=false2026.06 | 85 | — | 93 | — | — | 92 | — | |
| BAGEL (Ours)Baseline=BAGEL, Params=7B active2026.06 | 85 | 99 | 95 | 87 | 90 | 67 | 72 | |
| Z-ImageParam.=6B, Resolution=1024 x 10242026.03 | 84 | 100 | 94 | 78 | 93 | 62 | 77 | |
| BLIP3-o 8BParams=7B + 1.4B*, LLM rewriter=true2025.06 | 84 | — | — | — | — | — | — | |
| UniWorld-V1Params=7B + 12B*, LLM rewriter=true2025.06 | 84 | — | — | — | — | — | — | |
| Seedream 3.0Size=-2026.04 | 84 | 99 | 96 | 91 | 93 | 47 | 80 | |
| TarSize=7B2026.04 | 84 | 99 | 92 | 83 | 85 | 80 | 65 | |
| BLIP3-oSize=8B2026.04 | 84 | — | — | — | — | — | — | |
| UniWorld-V1Size=12B, LLM rewriters=true2026.04 | 84 | 98 | 93 | 81 | 89 | 74 | 71 | |
| Blip3-o# Params=8B, LLM rewriters=true2026.06 | 84 | — | — | — | — | — | — | |
| SUDERBaseline=Janus-Pro-7B, Params=7B2026.06 | 84 | 99 | 89 | 70 | 92 | 82 | 71 | |
| BLIP3o-8BBaseline=BLIP3o-8B, Params=8B2026.06 | 84 | 100 | 85 | 63 | 92 | 90 | 74 | |
| DeepGen1.0Param.=2B, Resolution=1024 x 10242026.03 | 83 | 99 | 97 | 68 | 90 | 71 | 71 | |
| BAGELParam.=7B, Resolution=1024 x 10242026.03 | 82 | 99 | 94 | 81 | 88 | 64 | 63 | |
| BAGELParams=7B + 7B*, LLM rewriter=false2025.06 | 82 | — | — | — | — | — | — | |
| FLUX.1 [dev]Size=12B, LLM rewriters=true2026.04 | 82 | 98 | 93 | 75 | 93 | 68 | 65 | |
| Z-Image-TurboSize=6B2026.04 | 82 | 100 | 95 | 77 | 89 | 65 | 68 | |
| FLUX.1 [Dev]# Params=12B, LLM rewriters=true2026.06 | 82 | — | 93 | — | — | 68 | — | |
| UniGameBaseline=Janus-Pro-7B, Params=7B2026.06 | 82 | 99 | 91 | 62 | 93 | 80 | 68 | |
| UniCornBaseline=BAGEL, Params=7B active2026.06 | 82 | 99 | 94 | 80 | 88 | 61 | 73 | |
| BAGELBaseline=BAGEL, Params=7B active2026.06 | 82 | 99 | 94 | 81 | 88 | 64 | 63 | |
| OmniGen2Param.=4B, Resolution=1024 x 10242026.03 | 80 | 100 | 95 | 64 | 88 | 55 | 76 | |
| Janus-ProParameters=7B2025.03 | 80 | — | — | — | — | — | — | |
| Janus-ProParams=-2025.06 | 80 | — | — | — | — | — | — | |
| MetaQuery-XLParams=7B + 1.6B*, LLM rewriter=true2025.06 | 80 | — | — | — | — | — | — | |
| Janus-ProSize=7B2026.04 | 80 | 99 | 89 | 59 | 90 | 79 | 66 | |
| Janus-Pro# Params=7B, LLM rewriters=false2026.06 | 80 | — | 89 | — | — | 79 | — | |
| Janus-Pro-7BBaseline=Janus-Pro-7B, Params=7B2026.06 | 80 | 99 | 89 | 59 | 90 | 79 | 66 | |
| UniRL (SFT)Baseline=Show-o2026.06 | 77 | 99 | 93 | 62 | 89 | 55 | 68 | |
| OrbitQuantModel=Z-Image-Turbo, Bit=W4A42026.07 | 76.7 | 99.7 | 88.9 | 78.1 | 88.8 | 45 | 59.8 | |
| AdaTSQModel=Z-Image-Turbo, Bit=W4A42026.07 | 76.2 | 99.4 | 89.1 | 68.1 | 87.2 | 52 | 61.3 | |
| Show-o2Parameters=7B2025.03 | 76 | — | — | — | — | — | — | |
| Show-o2Size=7B2026.04 | 76 | 100 | 87 | 58 | 92 | 52 | 62 | |
| Harmon# Params=1.5B, LLM rewriters=false2026.06 | 76 | — | 86 | — | — | 74 | — | |
| Show-o2# Params=7B, LLM rewriters=true2026.06 | 76 | — | 87 | — | — | 52 | — | |
| FP16Model=Z-Image-Turbo, Bit=16/162026.07 | 75.4 | 100 | 90.7 | 70.9 | 85.9 | 46.8 | 58.3 | |
| DualTokenParameters=7B2025.03 | 75 | — | — | — | — | — | — | |
| SD3-MSize=2B2026.04 | 74 | 99 | 94 | 72 | 89 | 33 | 60 | |
| SD3-Med# Params=2B, LLM rewriters=false2026.06 | 74 | — | 94 | — | — | 33 | — | |
| Show-o2Parameters=1.5B2025.03 | 73 | — | — | — | — | — | — | |
| Show-o2# Params=1.5B, LLM rewriters=false2026.06 | 73 | — | 86 | — | — | 46 | — | |
| DreamLiteParam.=0.39B, Resolution=1024 x 10242026.03 | 72 | 98 | 88 | 65 | 90 | 35 | 52 | |
| DualTokenParameters=3B2025.03 | 72 | — | — | — | — | — | — | |
| SVDQuantModel=Z-Image-Turbo, Bit=W4A42026.07 | 71.8 | 99.4 | 84.3 | 63.3 | 83.3 | 48.5 | 52 | |
| OrbitQuantModel=FLUX.1-schnell, Bit=W4A42026.07 | 70.3 | 99.1 | 88.1 | 70.6 | 80.3 | 32.3 | 51.2 | |
| SnapGenParam.=0.38B, Resolution=1024 x 10242026.03 | 70 | — | — | — | — | — | — | |
| Nitro-E-GRPOParam.=0.3B, Resolution=1024 x 10242026.03 | 70 | 100 | 88 | 63 | 86 | 32 | 48 | |
| Show-oBaseline=Show-o2026.06 | 69 | 98 | 85 | 67 | 81 | 28 | 55 | |
| Show-oParams=-2025.06 | 68 | — | — | — | — | — | — | |
| OmniGenParams=3.8B2025.06 | 68 | — | — | — | — | — | — | |
| AdaTSQModel=FLUX.1-schnell, Bit=W4A42026.07 | 68 | 99.7 | 89.4 | 62.2 | 79.3 | 27.8 | 49.8 | |
| FLUX.1-DevParam.=12B, Resolution=1024 x 10242026.03 | 67 | 99 | 81 | 79 | 74 | 20 | 47 | |
| SANA-1.6BParam.=1.6B, Resolution=1024 x 10242026.03 | 67 | 99 | 80 | 62 | 89 | 27 | 43 | |
| ViDiT-QModel=Z-Image-Turbo, Bit=W4A42026.07 | 66.8 | 97.2 | 70.5 | 58.4 | 77.7 | 43.5 | 53.3 | |
| FP16Model=FLUX.1-dev, Bit=16/162026.07 | 66.7 | 98.4 | 82.3 | 76.9 | 77.1 | 20.3 | 45 | |
| FP16Model=FLUX.1-schnell, Bit=16/162026.07 | 66.4 | 99.7 | 88.4 | 60 | 74.2 | 27.5 | 48.8 | |
| SnapGen++Param.=0.4B, Resolution=1024 x 10242026.03 | 66 | — | — | — | — | — | — | |
| EMU3Parameters=8B2025.03 | 66 | — | — | — | — | — | — | |
| FLUX.1-devParams=-2025.06 | 66 | — | — | — | — | — | — | |
| Emu3Params=-, LLM rewriter=true2025.06 | 66 | — | — | — | — | — | — | |
| Emu3Size=8B2026.04 | 66 | — | — | — | — | — | — | |
| Emu3# Params=8B, LLM rewriters=false2026.06 | 66 | — | — | — | — | — | — | |
| SANA-0.6BParam.=0.59B, Resolution=1024 x 10242026.03 | 64 | 98 | 78 | 59 | 86 | 22 | 40 | |
| OrbitQuantModel=FLUX.1-dev, Bit=W4A42026.07 | 63.3 | 98.8 | 76.8 | 69.1 | 75.5 | 17.8 | 42 | |
| Hunyuan-DiTParam.=1.5B, Resolution=1024 x 10242026.03 | 63 | 97 | 77 | 71 | 88 | 13 | 30 | |
| TokenFlow-XLParameters=14B2025.03 | 63 | — | — | — | — | — | — | |
| UniTokenParameters=7B2025.03 | 63 | — | — | — | — | — | — | |
| TransfusionSize=7B2026.04 | 63 | — | — | — | — | — | — | |
| SVDQuantModel=FLUX.1-schnell, Bit=W4A42026.07 | 62.4 | 99.4 | 91 | 45 | 70.8 | 26 | 42 | |
| SD3-mediumParams=-2025.06 | 62 | — | — | — | — | — | — | |
| AdaTSQModel=FLUX.1-dev, Bit=W4A42026.07 | 61.8 | 98.1 | 77 | 64 | 70.8 | 26 | 35 | |
| Janus2025.03 | 61 | — | — | — | — | — | — | |
| ILLUMEParameters=7B2025.03 | 61 | — | — | — | — | — | — | |
| JanusBaseline=Janus2026.06 | 61 | 97 | 68 | 30 | 84 | 46 | 42 | |
| ILLUMEBaseline=Vicuna-7B, Params=7B2026.06 | 61 | 99 | 86 | 45 | 71 | 39 | 28 | |
| OrbitQuantModel=FLUX.1-schnell, Bit=W2A42026.07 | 60.4 | 97.2 | 69.7 | 57.5 | 76.6 | 19.8 | 42 | |
| SVDQuantModel=FLUX.1-dev, Bit=W4A42026.07 | 57.3 | 98.1 | 71 | 61 | 69.8 | 14 | 30 | |
| Muse-VLParameters=7B2025.03 | 57 | — | — | — | — | — | — | |
| MUSE-VLSize=7B2026.04 | 57 | — | — | — | — | — | — | |
| MUSE-VL# Params=7B, LLM rewriters=false2026.06 | 57 | — | 64 | — | — | 25 | — | |
| VARGPT-v1.1 (Ours)Baseline=VARGPT-v1.1, Params=7B+2B2026.06 | 56 | 97 | 59 | 56 | 85 | 15 | 24 | |
| SDXL2025.03 | 55 | — | — | — | — | — | — | |
| SDXLParams=-2025.06 | 55 | — | — | — | — | — | — |