Text-to-Image Compositional Alignment on T2I-CompBench++ v2 (test)
86.97ColorCARINOX
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| CARINOXBackbone=SDXL-Turbo2025.09 | 86.97 | 74.82 | 82.7 | 30.1 | 41.17 | 59.92 | 32.32 | 49.22 | 57.15 | |
| CARINOXBackbone=SD-Turbo2025.09 | 86.33 | 76.09 | 82.29 | 25.88 | 41.55 | 62.48 | 33.72 | 50.41 | 57.34 | |
| CARINOXBackbone=SDXL-Turbo2025.09 | 86 | 85 | 87 | 78 | 78 | 66 | 79 | 71 | 79 | |
| CARINOXBackbone=PixArt-α DMD2025.09 | 85.45 | 77.21 | 80.76 | 32.72 | 41.64 | 62.95 | 32.56 | 48.78 | 57.76 | |
| CARINOBackbone=SD-Turbo2025.09 | 85.19 | 73.36 | 80.43 | 24.37 | 39.2 | 59.03 | 32.69 | 49.06 | 55.42 | |
| CARINOBackbone=SDXL-Turbo2025.09 | 84.92 | 72.03 | 79.77 | 28.58 | 40.69 | 58.35 | 31.41 | 48.59 | 55.54 | |
| CARINOBackbone=PixArt-α DMD2025.09 | 82.6 | 75.28 | 79.67 | 26.2 | 40.31 | 61.44 | 31.46 | 47.82 | 55.6 | |
| CARINOBackbone=SDXL-Turbo2025.09 | 79 | 77 | 82 | 75 | 76 | 64 | 78 | 61 | 74 | |
| CARINXBackbone=SDXL-Turbo2025.09 | 78.9 | 57.08 | 70.68 | 26.63 | 39.84 | 54.23 | 31.29 | 39.32 | 49.75 | |
| ReNOBackbone=SD-Turbo2025.09 | 78 | 62 | 75 | 22 | 38 | 57 | 32 | 48 | 51.5 | |
| ReNOBackbone=SDXL-Turbo2025.09 | 78 | 60 | 74 | 26 | 39 | 56 | 31 | 47 | 51.37 | |
| CARINOXBackbone=SD-Turbo2025.09 | 78 | 74 | 89 | 80 | 65 | 71 | 80 | 62 | 75 | |
| DALL-E 3Backbone=DALL-E 32025.09 | 77.85 | 62.05 | 70.36 | 28.65 | 37.44 | 58.8 | 30.03 | 37.73 | 50.36 | |
| ReNOBackbone=SDXL-Turbo2025.09 | 76 | 67 | 79 | 73 | 70 | 53 | 76 | 55 | 69 | |
| CARINXBackbone=SD-Turbo2025.09 | 74.76 | 56.61 | 62.16 | 23.66 | 34.21 | 52.95 | 31.26 | 38.41 | 46.75 | |
| ImageSelectBackbone=SDXL-Turbo2025.09 | 73.69 | 52.57 | 65.9 | 24.26 | 38.38 | 53.98 | 31.15 | 38.02 | 47.24 | |
| InitNOBackbone=SD v2.12025.09 | 70.38 | 46.94 | 52.12 | 20.27 | 35.24 | 48.92 | 31.05 | 35.74 | 42.58 | |
| CARINOBackbone=SD-Turbo2025.09 | 69 | 66 | 78 | 71 | 61 | 63 | 76 | 51 | 67 | |
| ImageSelectBackbone=SD-Turbo2025.09 | 68 | 51.72 | 57.75 | 23.17 | 33.73 | 50.27 | 31.36 | 37.25 | 44.16 | |
| PixArt-α-ftBackbone=PixArt-α-ft2025.09 | 66.9 | 49.27 | 64.77 | 20.64 | 39.01 | 50.58 | 31.97 | 34.33 | 44.68 | |
| Pick A PicBackbone=SDXL-Turbo2025.09 | 65.32 | 48.03 | 61.76 | 26.79 | 39.59 | 54.92 | 31.22 | 37.41 | 45.63 | |
| Attend-and-ExciteBackbone=SD v2.12025.09 | 64 | 45.17 | 59.63 | 14.55 | 32.22 | 45.5 | 31.11 | 33.55 | 40.72 | |
| ReNOBackbone=PixArt-α DMD2025.09 | 64 | 57 | 72 | 25 | 39 | 56 | 31 | 46 | 48.75 | |
| ReNOBackbone=SD-Turbo2025.09 | 63 | 61 | 63 | 66 | 59 | 61 | 72 | 48 | 62 | |
| SDXL-TurboBackbone=SDXL-Turbo2025.09 | 61 | 61 | 75 | 69 | 69 | 44 | 71 | 47 | 62 | |
| CARINXBackbone=PixArt-α DMD2025.09 | 59.66 | 48.55 | 56.43 | 23.48 | 36.97 | 54.63 | 31 | 38.05 | 43.6 | |
| SDXL-TurboBackbone=SDXL-Turbo2025.09 | 59.59 | 40.38 | 54.72 | 23.03 | 36.12 | 48.63 | 31.14 | 34.3 | 40.99 | |
| SDXLBackbone=SDXL2025.09 | 58.79 | 46.87 | 52.99 | 21.33 | 35.66 | 49.88 | 31.19 | 32.37 | 41.14 | |
| Pick A PicBackbone=SD-Turbo2025.09 | 58.71 | 48.42 | 54.46 | 15.04 | 35.59 | 51.37 | 31.23 | 37.68 | 41.56 | |
| ImageSelectBackbone=PixArt-α DMD2025.09 | 53.61 | 44.06 | 51.48 | 18.78 | 37.47 | 54.53 | 30.91 | 36.34 | 40.9 | |
| SD-TurboBackbone=SD-Turbo2025.09 | 52.52 | 44.34 | 48.88 | 18.81 | 31.12 | 49.14 | 30.95 | 33.49 | 38.66 | |
| SD v2.1Backbone=SD v2.12025.09 | 50.65 | 42.21 | 49.22 | 13.42 | 32.3 | 45.79 | 31.27 | 33.86 | 37.34 | |
| Structured DiffusionBackbone=SD v2.12025.09 | 49.9 | 42.18 | 49 | 13.86 | 32.24 | 45.5 | 31.11 | 33.55 | 37.17 | |
| SD-TurboBackbone=SD-Turbo2025.09 | 47 | 37 | 45 | 48 | 39 | 45 | 59 | 46 | 46 | |
| Pick A PicBackbone=PixArt-α DMD2025.09 | 44.75 | 36.9 | 46.58 | 19.87 | 37.04 | 53.93 | 30.82 | 35.55 | 38.18 | |
| PixArt-α DMDBackbone=PixArt-α DMD2025.09 | 41.45 | 34.87 | 36.67 | 22.13 | 34.41 | 48.96 | 30.61 | 34.66 | 35.47 | |
| SD v1.4Backbone=SD v1.42025.09 | 37.65 | 35.76 | 41.56 | 12.46 | 30.3 | 44.61 | 30.79 | 30.8 | 32.99 |