Class-conditional Image Generation on ImageNet (val)
323.7ISRQ-Transformer
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| RQ-TransformerParams=3.8B, H×W×D=8×8×4, guidance_or_sampling=true2022.06 | 323.7 | 3.8 | — | — | 82 | 50 | — | — | — | — | — | — | |
| DDT#Epoch=800, #Para.=675M, #Tok.=256, CFG=True2026.05 | 310.6 | — | — | — | 79 | 65 | — | — | — | — | — | 1.26 | |
| REPA-E#Epoch=800, #Para.=675M, #Tok.=256, CFG=True2026.05 | 306.3 | — | — | — | 79 | 64 | — | — | — | — | — | 1.29 | |
| VFMVAE#Epoch=640, #Para.=685M, #Tok.=256, CFG=True2026.05 | 300.2 | — | — | — | 78 | 66 | 4.63 | — | — | — | — | 1.31 | |
| VA-VAE#Epoch=800, #Para.=675M, #Tok.=256, CFG=True2026.05 | 295.3 | — | — | — | 79 | 65 | — | — | — | — | — | 1.35 | |
| ReDi#Epoch=800, #Para.=675M, #Tok.=256, CFG=True2026.05 | 295.1 | — | — | — | 78 | 64 | 4.66 | — | — | — | — | 1.61 | |
| VFMAE(DINOv2)#Epoch=800, #Para.=839M, #Tok.=256, CFG=True2026.05 | 294 | — | — | — | 77 | 69 | 5.84 | — | — | — | — | 1.25 | |
| AlignTok#Epoch=800, #Para.=675M, #Tok.=256, CFG=True2026.05 | 293.6 | — | — | — | 79 | 65 | — | — | — | — | — | 1.37 | |
| REPA#Epoch=1600, #Para.=675M, #Tok.=256, CFG=True2026.05 | 284 | — | — | — | 81 | 61 | 4.5 | — | — | — | — | 1.8 | |
| VFMAE(SigLIP2)#Epoch=800, #Para.=839M, #Tok.=256, CFG=True2026.05 | 280.9 | — | — | — | 76 | 68 | 5.93 | — | — | — | — | 1.29 | |
| DiT#Epoch=1600, #Para.=675M, #Tok.=256, CFG=True2026.05 | 278.2 | — | — | — | 83 | 57 | 4.6 | — | — | — | — | 2.27 | |
| MaskDiT#Epoch=1600, #Para.=675M, #Tok.=256, CFG=True2026.05 | 276.6 | — | — | — | 80 | 61 | 5.67 | — | — | — | — | 2.28 | |
| OriginSampling/Steps=DDPM/250, FLOPs (T)=118.68, Latency (s)=2.512025.12 | 275.64 | 2.23 | — | — | 83 | 58 | 4.57 | — | 1 | 0 | — | — | |
| Uniform 50% stepsSampling/Steps=DDPM/250, FLOPs (T)=59.34, Latency (s)=1.262025.12 | 270.4 | 2.42 | — | — | 82 | 57 | 5.04 | 8.55 | 0.14 | 0.78 | — | — | |
| SiT-XL/2#Epoch=1600, #Para.=675M, #Tok.=256, CFG=True2026.05 | 270.3 | — | — | — | 82 | 59 | 4.5 | — | — | — | — | 2.06 | |
| FAE#Epoch=800, #Para.=675M, #Tok.=256, CFG=True2026.05 | 268 | — | — | — | 80 | 64 | — | — | — | — | — | 1.29 | |
| FasterDIT#Epoch=400, #Para.=675M, #Tok.=256, CFG=True2026.05 | 264 | — | — | — | 81 | 60 | 4.63 | — | — | — | — | 2.03 | |
| DDT#Epoch=80, #Para.=675M, #Tok.=256, CFG=True2026.05 | 263.7 | — | — | — | 78 | 63 | — | — | — | — | — | 1.52 | |
| RAE#Epoch=1400, #Para.=839M, #Tok.=256, CFG=True2026.05 | 262.6 | — | — | — | 78 | 67 | — | — | — | — | — | 1.13 | |
| StyleGAN-XLParams=166M, guidance_or_sampling=true2022.06 | 262.1 | 2.3 | — | — | 78 | 53 | — | — | — | — | — | — | |
| VFMVAE#Epoch=64, #Para.=685M, #Tok.=256, CFG=True2026.05 | 261.7 | — | — | — | 83 | 58 | 5.23 | — | — | — | — | 2.03 | |
| AlignTok#Epoch=64, #Para.=675M, #Tok.=256, CFG=True2026.05 | 260.9 | — | — | — | 81 | 61 | — | — | — | — | — | 1.9 | |
| RAE†#Epoch=1400, #Para.=839M, #Tok.=256, CFG=True2026.05 | 254.6 | — | — | — | 77 | 67 | 4.65 | — | — | — | — | 1.19 | |
| ToCa(N6) + CEMSampling/Steps=DDPM/250, FLOPs (T)=36.48, Latency (s)=0.822025.12 | 248.58 | 3.09 | — | — | 80 | 59 | 6 | 22.63 | 0.76 | 0.16 | — | — | |
| RAE†#Epoch=800, #Para.=839M, #Tok.=256, CFG=True2026.05 | 248.5 | — | — | — | 76 | 67 | 4.7 | — | — | — | — | 1.27 | |
| ToCa(N6)Sampling/Steps=DDPM/250, FLOPs (T)=36.3, Latency (s)=0.842025.12 | 246.59 | 3.08 | — | — | 79 | 59 | 6.58 | 20.92 | 0.71 | 0.21 | — | — | |
| OriginBit-width (W/A)=16/16, Size (MB)=1349, Latency (s)=0.622025.12 | 245.85 | 5.31 | — | — | 81 | 68 | 17.61 | — | 1 | 0 | — | — | |
| FAE#Epoch=80, #Para.=675M, #Tok.=256, CFG=True2026.05 | 243.8 | — | — | — | 82 | 61 | — | — | — | — | — | 1.7 | |
| RAE#Epoch=1400, #Para.=839M, #Tok.=256, CFG=False2026.05 | 242.9 | — | — | — | 79 | 63 | — | — | — | — | — | 1.51 | |
| VFMVAE#Epoch=640, #Para.=685M, #Tok.=256, CFG=False2026.05 | 241.6 | — | — | — | 81 | 62 | 4.55 | — | — | — | — | 1.62 | |
| DDIM-50 stepsBackbone=DiT-XL/2, Latency(s)=0.851, Speed=1.00×, FLOPs(T)=22.88, Ratio=1.00×, Mem(GB)=3.1832026.02 | 241.1 | 2.226 | — | — | — | — | 4.275 | — | — | — | — | — | |
| VFMAE(DINOv2)#Epoch=800, #Para.=839M, #Tok.=256, CFG=False2026.05 | 240.9 | — | — | — | 76 | 67 | 5.78 | — | — | — | — | 1.65 | |
| Q-DiT + CEMBit-width (W/A)=6/8, Size (MB)=518, Latency (s)=0.222025.12 | 240.36 | 5.51 | — | — | 80 | 68 | 17.49 | 31.06 | 0.93 | 0.05 | — | — | |
| OriginSampling/Steps=DDIM/50, FLOPs (T)=23.74, Latency (s)=0.532025.12 | 239.93 | 2.25 | — | — | 80 | 59 | 4.33 | — | 1 | 0 | — | — | |
| FAE#Epoch=800, #Para.=675M, #Tok.=256, CFG=False2026.05 | 239.8 | — | — | — | 81 | 63 | — | — | — | — | — | 1.48 | |
| Q-DiTBit-width (W/A)=6/8, Size (MB)=518, Latency (s)=0.452025.12 | 237.34 | 5.44 | — | — | 80 | 68 | 17.61 | 31.1 | 0.95 | 0.04 | — | — | |
| LazyDiTSampling/Steps=DDIM/50, FLOPs (T)=11.93, Latency (s)=0.282025.12 | 237.03 | 2.7 | — | — | 80 | 59 | 4.47 | — | — | — | — | — | |
| RAE†#Epoch=1400, #Para.=839M, #Tok.=256, CFG=False2026.05 | 235.9 | — | — | — | 78 | 64 | 5.15 | — | — | — | — | 1.53 | |
| VFMAE(SigLIP2)#Epoch=800, #Para.=839M, #Tok.=256, CFG=False2026.05 | 235.4 | — | — | — | 76 | 68 | 5.75 | — | — | — | — | 1.7 | |
| RAE†#Epoch=800, #Para.=839M, #Tok.=256, CFG=False2026.05 | 232.3 | — | — | — | 78 | 65 | 5.26 | — | — | — | — | 1.6 | |
| TaylorSeer(N6) + CEMSampling/Steps=DDIM/50, FLOPs (T)=4.76, Latency (s)=0.132025.12 | 231.1 | 3.08 | — | — | 80 | 57 | 6.43 | 25.64 | 0.83 | 0.1 | — | — | |
| DPCacheBackbone=DiT-XL/2, K=16, Latency(s)=0.344, Speed=2.47×, FLOPs(T)=7.326, Ratio=3.12×, Mem(GB)=3.1902026.02 | 230.6 | 2.562 | — | — | — | — | 4.503 | — | — | — | — | — | |
| Contextual RQ-TransformerParams=1.4B, H×W×D=8×8×42022.06 | 224.6 | 3.41 | — | — | 79 | 54 | — | — | — | — | — | — | |
| SpeCaBackbone=DiT-XL/2, Variant=1, Latency(s)=0.384, Speed=2.22×, FLOPs(T)=4.285, Ratio=5.34×, Mem(GB)=3.2822026.02 | 224.24 | 3.185 | — | — | — | — | 5.69 | — | — | — | — | — | |
| VFMAE(SigLIP2)#Epoch=80, #Para.=839M, #Tok.=256, CFG=True2026.05 | 224.2 | — | — | — | 76 | 67 | 5.65 | — | — | — | — | 1.4 | |
| TaylorSeer(N6)Sampling/Steps=DDIM/50, FLOPs (T)=4.76, Latency (s)=0.142025.12 | 223.83 | 3.56 | — | — | 79 | 56 | 7.52 | 24.69 | 0.8 | 0.13 | — | — | |
| Contextual RQ-TransformerParams=821M, H×W×D=8×8×42022.06 | 221.9 | 3.45 | — | — | 82 | 52 | — | — | — | — | — | — | |
| RAE†#Epoch=80, #Para.=839M, #Tok.=256, CFG=True2026.05 | 221.7 | — | — | — | 80 | 61 | 4.58 | — | — | — | — | 1.76 | |
| 40% stepsBackbone=DiT-XL/2, Latency(s)=0.341, Speed=2.50×, FLOPs(T)=9.154, Ratio=2.50×, Mem(GB)=3.1832026.02 | 221.45 | 3.504 | — | — | — | — | 4.918 | — | — | — | — | — | |
| VFMVAE#Epoch=80, #Para.=685M, #Tok.=256, CFG=False2026.05 | 218.8 | — | — | — | 83 | 58 | 5.03 | — | — | — | — | 2.22 | |
| DuCa(N5) + CEMSampling/Steps=DDIM/50, FLOPs (T)=6.73, Latency (s)=0.172025.12 | 218.66 | 3.96 | — | — | 78 | 55 | 5.87 | 23 | 0.76 | 0.16 | — | — | |
| VFMAE(DINOv2)#Epoch=80, #Para.=839M, #Tok.=256, CFG=True2026.05 | 217.5 | — | — | — | 74 | 68 | 6.1 | — | — | — | — | 1.68 | |
| DPCacheBackbone=DiT-XL/2, K=12, Latency(s)=0.282, Speed=3.02×, FLOPs(T)=5.495, Ratio=4.16×, Mem(GB)=3.1902026.02 | 215.99 | 3.285 | — | — | — | — | 5.063 | — | — | — | — | — | |
| LlamaGen-L + Reward-based trainingBackbone=Large, CFG scale=1.5, Reward-based training=true2026.03 | 215.9 | 3.83 | — | — | 79 | 63 | — | — | — | — | 23.6 | — | |
| VFMVAE#Epoch=64, #Para.=685M, #Tok.=256, CFG=False2026.05 | 215.2 | — | — | — | — | — | — | — | — | — | — | 2.42 | |
| RAE#Epoch=80, #Para.=839M, #Tok.=256, CFG=True2026.05 | 214.8 | — | — | — | 82 | 59 | — | — | — | — | — | 2.16 | |
| Uniform 33% stepsSampling/Steps=DDIM/50, FLOPs (T)=8.07, Latency (s)=0.182025.12 | 214.35 | 4.24 | — | — | 77 | 56 | 5.52 | 9.22 | 0.17 | 0.81 | — | — | |
| Q-DiT + CEMBit-width (W/A)=4/8, Size (MB)=347, Latency (s)=0.22025.12 | 213.5 | 6.2 | — | — | 76 | 69 | 17.62 | 24.99 | 0.82 | 0.14 | — | — | |
| ToCa(N5) + CEMSampling/Steps=DDIM/50, FLOPs (T)=7.14, Latency (s)=0.182025.12 | 212.13 | 4.68 | — | — | 77 | 55 | 6.41 | 21.59 | 0.72 | 0.2 | — | — | |
| LDM-8-GParams=506M, H×W×D=32×32, guidance_or_sampling=true2022.06 | 209.52 | 7.76 | — | — | 84 | 35 | — | — | — | — | — | — | |
| Q-DiTBit-width (W/A)=4/8, Size (MB)=347, Latency (s)=0.392025.12 | 209.3 | 6.31 | — | — | 76 | 69 | 17.81 | 24.88 | 0.82 | 0.14 | — | — | |
| FAE#Epoch=80, #Para.=675M, #Tok.=256, CFG=False2026.05 | 207.6 | — | — | — | 82 | 59 | — | — | — | — | — | 2.08 | |
| AlignTok#Epoch=800, #Para.=675M, #Tok.=256, CFG=False2026.05 | 206.2 | — | — | — | 76 | 67 | — | — | — | — | — | 2.04 | |
| 30% stepsBackbone=DiT-XL/2, Latency(s)=0.257, Speed=3.31×, FLOPs(T)=6.865, Ratio=3.33×, Mem(GB)=3.1832026.02 | 205.65 | 5.138 | — | — | — | — | 6.12 | — | — | — | — | — | |
| VA-VAE#Epoch=800, #Para.=675M, #Tok.=256, CFG=False2026.05 | 205.6 | — | — | — | 77 | 65 | — | — | — | — | — | 2.17 | |
| SpeCaBackbone=DiT-XL/2, Variant=2, Latency(s)=0.367, Speed=2.32×, FLOPs(T)=3.656, Ratio=6.26×, Mem(GB)=3.2822026.02 | 203.17 | 4.705 | — | — | — | — | 7.835 | — | — | — | — | — | |
| RAE†#Epoch=80, #Para.=839M, #Tok.=256, CFG=False2026.05 | 203 | — | — | — | 81 | 60 | 5.26 | — | — | — | — | 2.28 | |
| BigGAN-deepParams=112M2022.06 | 202.6 | 6.95 | — | — | 87 | 23 | — | — | — | — | — | — | |
| TaylorSeerBackbone=DiT-XL/2, Variant=1, Latency(s)=0.444, Speed=1.92×, FLOPs(T)=3.256, Ratio=7.03×, Mem(GB)=3.2782026.02 | 201.94 | 4.776 | — | — | — | — | 7.793 | — | — | — | — | — | |
| DuCa(N5)Sampling/Steps=DDIM/50, FLOPs (T)=6.32, Latency (s)=0.172025.12 | 199.64 | 6.07 | — | — | 74 | 52 | 6.64 | 16.63 | 0.53 | 0.39 | — | — | |
| ToCa(N5)Sampling/Steps=DDIM/50, FLOPs (T)=7.44, Latency (s)=0.22025.12 | 199.48 | 6.37 | — | — | 74 | 53 | 7.09 | 16.56 | 0.53 | 0.4 | — | — | |
| LlamaGen-LBackbone=Large, CFG scale=1.5, Reward-based training=false2026.03 | 196.78 | 4.64 | — | — | 78 | 63 | — | — | — | — | 23.5 | — | |
| LlamaGen-XL + Reward-based trainingBackbone=Extra-Large, CFG scale=1.5, Reward-based training=true2026.03 | 195.58 | 3.82 | — | — | 77 | 67 | — | — | — | — | 23.7 | — | |
| LlamaGen-XLBackbone=Extra-Large, CFG scale=1.5, Reward-based training=false2026.03 | 187.75 | 3.96 | — | — | 74 | 67 | — | — | — | — | 23.46 | — | |
| ADM-GParams=608M, guidance_or_sampling=true2022.06 | 186.7 | 4.59 | — | — | 82 | 52 | — | — | — | — | — | — | |
| TaylorSeerBackbone=DiT-XL/2, Variant=2, Latency(s)=0.431, Speed=1.97×, FLOPs(T)=2.800, Ratio=8.17×, Mem(GB)=3.2782026.02 | 186.55 | 6.163 | — | — | — | — | 9.503 | — | — | — | — | — | |
| MaskGITParams=227M, H×W×D=16×16×12022.06 | 182.1 | 6.18 | — | — | 80 | 51 | — | — | — | — | — | — | |
| MaskDiT#Epoch=1600, #Para.=675M, #Tok.=256, CFG=False2026.05 | 177.9 | — | — | — | 74 | 60 | 10.34 | — | — | — | — | 5.69 | |
| VFMAE(DINOv2)#Epoch=80, #Para.=839M, #Tok.=256, CFG=False2026.05 | 176.5 | — | — | — | 75 | 64 | 6.17 | — | — | — | — | 3.29 | |
| IC-GANResolution=256, Channel multiplier=96, Data Augmentation=(d)2021.09 | 173.8 | 8.2 | — | — | — | — | — | — | — | — | — | — | |
| Real data (validation)Type=Ground Truth2021.11 | 173.33 | — | 70.822 | 89.574 | — | — | — | — | — | — | — | — | |
| Contextual RQ-TransformerParams=371M, H×W×D=8×8×42022.06 | 172.6 | 5.45 | — | — | 81 | 49 | — | — | — | — | — | — | |
| VFMAE(SigLIP2)#Epoch=80, #Para.=839M, #Tok.=256, CFG=False2026.05 | 172.1 | — | — | — | 75 | 65 | 5.93 | — | — | — | — | 3.34 | |
| LlamaGen-B + Reward-based trainingBackbone=Base, CFG scale=1.5, Reward-based training=true2026.03 | 163.37 | 6.31 | — | — | 82 | 54 | — | — | — | — | 23.47 | — | |
| REPA-E#Epoch=800, #Para.=675M, #Tok.=256, CFG=False2026.05 | 158.3 | — | — | — | 70 | 68 | — | — | — | — | — | 5.78 | |
| DDT#Epoch=800, #Para.=675M, #Tok.=256, CFG=False2026.05 | 154.7 | — | — | — | 68 | 69 | — | — | — | — | — | 6.27 | |
| IC-GANResolution=256, Channel multiplier=64, Data Augmentation=(d, i)2021.09 | 152.6 | 7.5 | — | — | — | — | — | — | — | — | — | — | |
| AlignTok#Epoch=64, #Para.=675M, #Tok.=256, CFG=False2026.05 | 148.9 | — | — | — | 77 | 62 | — | — | — | — | — | 3.71 | |
| BigGANResolution=256, Channel multiplier=96, Original paper numbers=true2021.09 | 144.2 | 8.1 | — | — | — | — | — | — | — | — | — | — | |
| IC-GANResolution=256, Channel multiplier=642021.09 | 143.7 | 8.3 | — | — | — | — | — | — | — | — | — | — | |
| BigGANResolution=256, Channel multiplier=64, Trained using open source code=true2021.09 | 139.1 | 8 | — | — | — | — | — | — | — | — | — | — | |
| DDT#Epoch=80, #Para.=675M, #Tok.=256, CFG=False2026.05 | 135.2 | — | — | — | 69 | 67 | — | — | — | — | — | 6.62 | |
| RQ-TransformerParams=3.8B, H×W×D=8×8×42022.06 | 134 | 7.55 | — | — | 73 | 58 | — | — | — | — | — | — | |
| SiT-XL/2#Epoch=1600, #Para.=675M, #Tok.=256, CFG=False2026.05 | 131.7 | — | — | — | 68 | 67 | 6.32 | — | — | — | — | 8.61 | |
| FasterDIT#Epoch=400, #Para.=675M, #Tok.=256, CFG=False2026.05 | 131.3 | — | — | — | 67 | 69 | 5.45 | — | — | — | — | 7.91 | |
| BigGANResolution=256, Channel multiplier=64, Data Augmentation=(d), Trained using open source code=true2021.09 | 125 | 8.3 | — | — | — | — | — | — | — | — | — | — | |
| REPA-E#Epoch=80, #Para.=675M, #Tok.=256, CFG=False2026.05 | 122.6 | — | — | — | 70 | 65 | — | — | — | — | — | 7.9 | |
| DiT#Epoch=1600, #Para.=675M, #Tok.=256, CFG=False2026.05 | 121.5 | — | — | — | 67 | 67 | 6.85 | — | — | — | — | 9.62 | |
| LlamaGen-BBackbone=Base, CFG scale=1.5, Reward-based training=false2026.03 | 119.52 | 7.06 | — | — | 74 | 61 | — | — | — | — | 22.62 | — | |
| RQ-TransformerParams=1.4B, H×W×D=8×8×42022.06 | 119 | 8.71 | — | — | 71 | 58 | — | — | — | — | — | — |