Text-to-Image Generation on UNIGENBENCH (test)
92.48Overall ScoreGPT-4o
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GPT-4oAccess=Closed-source2025.08 | 92.48 | 98.98 | 98.22 | 94.01 | 90.78 | 94.33 | 83.79 | 91.21 | 92.89 | 91.35 | 89.24 | |
| Imagen-4.0-UltraAccess=Closed-source2025.08 | 91.65 | 99.1 | 97.78 | 92.09 | 92.1 | 93.53 | 80.45 | 87.83 | 91.37 | 92.91 | 89.37 | |
| Seedream-4.0Access=Closed-source2025.08 | 87.35 | 98.8 | 95.41 | 88.57 | 85.65 | 87.69 | 67.73 | 78.88 | 86.08 | 90.67 | 93.97 | |
| Nano BananaAccess=Closed-source2025.08 | 87.29 | 98.59 | 96.2 | 87.99 | 87.36 | 92.47 | 73.41 | 83.82 | 88.34 | 91.42 | 73.28 | |
| FLUX-Kontext-MaxAccess=Closed-source2025.08 | 80 | 96.59 | 94.19 | 80.93 | 77.38 | 85.08 | 61.36 | 78.53 | 78.99 | 85.04 | 61.92 | |
| Seedream-3.0Access=Closed-source2025.08 | 78.41 | 98.19 | 94.9 | 84.62 | 83.14 | 80.18 | 51.83 | 60.3 | 72.32 | 88.74 | 69.86 | |
| Qwen-ImageAccess=Open-source2025.08 | 78.36 | 94.7 | 94.15 | 87.93 | 82.6 | 80.08 | 51.59 | 60.96 | 72.94 | 86.57 | 72.13 | |
| HiDream-I1-FullAccess=Open-source2025.08 | 71.36 | 92.3 | 93.67 | 73.4 | 72.53 | 74.24 | 40.45 | 62.43 | 60.31 | 77.61 | 66.67 | |
| FLUX-Pro-UltraAccess=Closed-source2025.08 | 70.46 | 90.99 | 91.3 | 76.79 | 71.39 | 78.05 | 41.46 | 68.18 | 68.17 | 80.6 | 37.64 | |
| Pref-GRPOAccess=Open-source2025.08 | 69.46 | 88.4 | 90.35 | 75 | 69.77 | 76.52 | 44.09 | 63.27 | 62.43 | 77.61 | 47.13 | |
| DALL-E-3Access=Closed-source2025.08 | 68.85 | 94.43 | 92.64 | 75.76 | 70.78 | 78.31 | 46.22 | 69.22 | 71.08 | 65.65 | 24.43 | |
| Keling-KetuAccess=Closed-source2025.08 | 65.93 | 92.27 | 86.62 | 71.66 | 68.73 | 70.94 | 43.75 | 71.26 | 60.81 | 77.23 | 16.03 | |
| SD-3.5-LargeAccess=Open-source2025.08 | 62.89 | 88.6 | 89.72 | 68.8 | 61.98 | 67.51 | 32.05 | 59.89 | 58.38 | 67.72 | 34.2 | |
| Show-o2Access=Open-source2025.08 | 61.9 | 87.4 | 85.44 | 69.87 | 69.01 | 68.78 | 39.55 | 60.83 | 63.79 | 73.13 | 1.15 | |
| Janus-ProAccess=Open-source2025.08 | 61.36 | 90.4 | 86.55 | 68.59 | 63.88 | 69.54 | 35.68 | 64.04 | 60.18 | 72.76 | 2.01 | |
| FLUX.1-devAccess=Open-source2025.08 | 60.97 | 85 | 87.5 | 67.2 | 62.26 | 66.88 | 29.77 | 62.3 | 45.75 | 70.9 | 32.18 | |
| BagelAccess=Open-source2025.08 | 59.91 | 90.08 | 85.42 | 67.73 | 62.14 | 70.64 | 23.85 | 65.85 | 56.86 | 76.56 | 0 | |
| BLIP3-oAccess=Open-source2025.08 | 59.57 | 92.81 | 79.97 | 64.77 | 64.59 | 65.99 | 36.78 | 69.05 | 54.57 | 67.19 | 0 | |
| CogView4Access=Open-source2025.08 | 56 | 80.8 | 81.96 | 63.14 | 59.51 | 60.91 | 27.95 | 54.81 | 44.97 | 69.03 | 16.95 | |
| JanusAccess=Open-source2025.08 | 51.6 | 90.08 | 73.56 | 55.34 | 50.92 | 56.54 | 28.74 | 61.74 | 47.1 | 52.01 | 0 | |
| Hunyuan-DiTAccess=Open-source2025.08 | 51.38 | 94.1 | 80.7 | 62.71 | 49.05 | 59.64 | 24.55 | 55.48 | 41.62 | 44.78 | 1.15 | |
| Janus-flowAccess=Open-source2025.08 | 47.1 | 86.34 | 62.98 | 49.2 | 43.57 | 51.45 | 22.41 | 62.8 | 46.49 | 45.76 | 0 | |
| Playground 2.5Access=Open-source2025.08 | 45.61 | 89.5 | 76.11 | 52.78 | 42.68 | 51.52 | 16.59 | 53.21 | 35.44 | 37.13 | 1.15 | |
| Emu3Access=Open-source2025.08 | 45.42 | 87.5 | 76.42 | 50.11 | 40.4 | 48.6 | 19.32 | 50.67 | 36.21 | 43.84 | 1.15 | |
| SDXLAccess=Open-source2025.08 | 40.22 | 87.45 | 72.28 | 44.66 | 35.1 | 46.37 | 10.34 | 48.48 | 26.68 | 30.8 | 0 |