Text-to-Image Generation on sDCI
1.07IRBF16
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| BF16Model=SANA-1.6B, Precision=BF16, Inference Steps=202026.05 | 1.07 | — | 22.8 | — | — | |
| Q-DiTModel=SANA-1.6B, Precision=INT W4A8, Inference Steps=202026.05 | 1.06 | — | 22.6 | 0.277 | 15.8 | |
| DiRotQModel=SANA-1.6B, Precision=INT W4A8, Inference Steps=202026.05 | 1.06 | — | 22.9 | 0.097 | 21.9 | |
| SVDQuantModel=SANA-1.6B, Precision=INT W4A4, Inference Steps=202026.05 | 1.06 | — | 21.5 | 0.235 | 16.8 | |
| DiRotQModel=SANA-1.6B, Precision=INT W4A4, Inference Steps=202026.05 | 1.06 | — | 22.9 | 0.104 | 21.4 | |
| SVDQuantModel=SANA-1.6B, Precision=NVFP W4A4, Inference Steps=202026.05 | 1.06 | — | 22.8 | 0.181 | 18.1 | |
| DiRotQModel=SANA-1.6B, Precision=NVFP W4A4, Inference Steps=202026.05 | 1.06 | — | 22.4 | 0.108 | 21.2 | |
| ViDiT-QModel=SANA-1.6B, Precision=INT W4A4, Inference Steps=202026.05 | 1.03 | — | 22.7 | 0.273 | 15.9 | |
| BF16Model=FLUX.1-dev, Precision=BF16, Inference Steps=252026.05 | 1.02 | — | 25 | — | — | |
| DiRotQModel=FLUX.1-dev, Precision=INT W4A8, Inference Steps=252026.05 | 1.02 | — | 24.8 | 0.146 | 23.2 | |
| w4a4r32Precision/Quantization Scheme=w4a4r32, Model=Sana, Resolution=1024x1024, Guidance scale=4.5, Number of samples=10242026.03 | 1.0172 | 26.707 | 62.447 | — | — | |
| TMPDiffPrecision/Quantization Scheme=Ours, Model=Sana, Resolution=1024x1024, Guidance scale=4.5, Number of samples=10242026.03 | 1.0155 | 26.728 | 62.468 | — | — | |
| SVDQuantModel=FLUX.1-dev, Precision=INT W4A4, Inference Steps=252026.05 | 1.01 | — | 24.7 | 0.273 | 19.2 | |
| DiRotQModel=FLUX.1-dev, Precision=INT W4A4, Inference Steps=252026.05 | 1.01 | — | 24.9 | 0.156 | 22.8 | |
| SVDQuantModel=FLUX.1-dev, Precision=NVFP W4A4, Inference Steps=252026.05 | 1.01 | — | 24.8 | 0.201 | 21.2 | |
| DiRotQModel=FLUX.1-dev, Precision=NVFP W4A4, Inference Steps=252026.05 | 1.01 | — | 25 | 0.159 | 22.7 | |
| Q-DiTModel=FLUX.1-dev, Precision=INT W4A8, Inference Steps=252026.05 | 1 | — | 25 | 0.24 | 20.1 | |
| FP16 BaselineFormat=FP16, Precision (W-A)=16-162026.04 | 0.966 | — | 24.8 | — | — | |
| DiRotQModel=PixArt-Σ, Precision=INT W4A4, Inference Steps=202026.05 | 0.965 | — | 23.1 | 0.251 | 18 | |
| SVDQuantModel=PixArt-Σ, Precision=NVFP W4A4, Inference Steps=202026.05 | 0.964 | — | 23.2 | 0.288 | 17.4 | |
| DiRotQModel=PixArt-Σ, Precision=NVFP W4A4, Inference Steps=202026.05 | 0.964 | — | 23 | 0.241 | 18.4 | |
| FP16Model=PixArt-Σ, Precision=FP16, Inference Steps=202026.05 | 0.963 | — | 24.8 | — | — | |
| DiRotQModel=PixArt-Σ, Precision=INT W4A8, Inference Steps=202026.05 | 0.956 | — | 24.5 | 0.236 | 18.4 | |
| Q-DiTModel=PixArt-Σ, Precision=INT W4A8, Inference Steps=202026.05 | 0.945 | — | 26.1 | 0.518 | 13 | |
| LoRaQFormat=MXINT4, Precision (W-A)=4-42026.04 | 0.943 | — | 23.7 | 0.374 | 15.6 | |
| ViDiT-QModel=PixArt-Σ, Precision=INT W4A4, Inference Steps=202026.05 | 0.942 | — | 26.5 | 0.717 | 9.3 | |
| SVDQuantModel=PixArt-Σ, Precision=INT W4A4, Inference Steps=202026.05 | 0.922 | — | 25.8 | 0.352 | 16.4 | |
| SVDQuantFormat=MXINT4, Precision (W-A)=4-42026.04 | 0.902 | — | 26.1 | 0.435 | 14.7 | |
| bfloat16Precision/Quantization Scheme=bfloat16, Model=Sana, Resolution=1024x1024, Guidance scale=4.5, Number of samples=10242026.03 | 0.8131 | 26.54 | 67.037 | — | — | |
| PTQ4DiTModel=SANA-1.6B, Precision=INT W4A8, Inference Steps=202026.05 | 0.716 | — | 27.6 | 0.686 | 9.3 | |
| PTQ4DiTModel=PixArt-Σ, Precision=INT W4A8, Inference Steps=202026.05 | 0.56 | — | 47.1 | 0.649 | 11 | |
| ViDiT-QModel=FLUX.1-dev, Precision=INT W4A4, Inference Steps=252026.05 | 0.456 | — | 32.8 | 0.671 | 12.6 |