Image Generation on ImageNet 256x256 (test)
1.36FIDSiT-XL/2 + REG
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| SiT-XL/2 + REGEpochs=800, w/o Ext.=false, CFG=true2026.05 | 1.36 | — | — | — | 299.4 | 77 | 66 | 4.25 | |
| SiT-XL/2 + AHPAEpochs=800, w/o Ext.=true, CFG=true2026.05 | 1.4 | — | — | — | 317.5 | 81 | 64 | 4.12 | |
| SiT-XL/2 + REPAEpochs=800, w/o Ext.=false, CFG=true2026.05 | 1.42 | — | — | — | 311.4 | 80 | 63 | 4.7 | |
| MaskBitLatent Representation=discrete, #tokens=256, codebook size=16384, #Params=305M, #Steps=2562024.09 | 1.52 | — | — | — | 328.6 | — | — | — | |
| SiT-XL/2 + SRA 2Epochs=800, w/o Ext.=true, CFG=true2026.05 | 1.52 | — | — | — | 316.2 | 82 | 62 | 4.63 | |
| MAR-HLatent Representation=continuous, #tokens=256x16, #Params=943M, #Steps=256, Concurrent=true2024.09 | 1.55 | — | — | — | 303.7 | — | — | — | |
| SiT-XL/2 + AHPAEpochs=400, w/o Ext.=true, CFG=true2026.05 | 1.56 | — | — | — | 308.2 | 81 | 63 | 4.15 | |
| MDTv2Latent Representation=continuous, #tokens=1024x4, #Params=676M, #Steps=250, Tokenizer training data=OpenImages, Concurrent=true2024.09 | 1.58 | — | — | — | 314.7 | — | — | — | |
| SiT-XL/2 + SRAEpochs=800, w/o Ext.=true, CFG=true2026.05 | 1.58 | — | — | — | 305.7 | 80 | 63 | 4.65 | |
| MaskBitLatent Representation=discrete, #tokens=256, codebook size=16384, #Params=305M, #Steps=642024.09 | 1.62 | — | — | — | 338.7 | — | — | — | |
| MaskBitLatent Representation=discrete, #tokens=256, codebook size=4096, #Params=305M, #Steps=642024.09 | 1.65 | — | — | — | 341.8 | — | — | — | |
| RAEv2K=7, Training-free Encoder=true, Recon-Gen Tradeoff Control=true, Epochs=802026.05 | 1.65 | — | — | — | 228 | — | — | — | |
| DiMRLatent Representation=continuous, #tokens=1024x4, #Params=505M, #Steps=250, Tokenizer training data=OpenImages, Concurrent=true2024.09 | 1.7 | — | — | — | 289 | — | — | — | |
| DiffiTClass=Diffusion2023.12 | 1.73 | — | — | — | 276.49 | 80 | 62 | — | |
| MAGVIT-v2Latent Representation=discrete, #tokens=256, codebook size=262144, #Params=307M, #Steps=642024.09 | 1.78 | — | — | — | 319.4 | — | — | — | |
| SiT-XL/2 + AHPAEpochs=200, w/o Ext.=true, CFG=true2026.05 | 1.78 | — | — | — | 291.8 | 82 | 61 | 4.26 | |
| MDTLatent Representation=continuous, #tokens=1024x4, #Params=676M, #Steps=250, Tokenizer training data=OpenImages, LAION-Aesthetics/-Humans2024.09 | 1.79 | — | — | — | 283 | — | — | — | |
| VARLatent Representation=discrete, #tokens=680, codebook size=4096, #Params=2.0B, #Steps=10, Tokenizer training data=OpenImages, Concurrent=true2024.09 | 1.92 | — | — | — | 350.2 | — | — | — | |
| TiTok-S-128Latent Representation=discrete, #tokens=128, codebook size=4096, #Params=287M, #Steps=64, Concurrent=true2024.09 | 1.97 | — | — | — | 281.8 | — | — | — | |
| DiT-XL/2 + iSSDEpochs=1400+0.8, w/o Ext.=false, CFG=true2026.05 | 2.02 | — | — | — | 250 | 81 | 60 | 4.22 | |
| SiT-XL/2Epochs=1400, w/o Ext.=true, CFG=true2026.05 | 2.06 | — | — | — | 270.3 | 82 | 59 | 4.5 | |
| MaskGITLatent Representation=discrete, Tokenizer=VQGAN+ (ours), #tokens=256, codebook size=4096, #Params=310M, #Steps=642024.09 | 2.12 | — | — | — | 300.8 | — | — | — | |
| SiT-XL/2 + AHPAEpochs=100, w/o Ext.=true, CFG=true2026.05 | 2.15 | — | — | — | 265.4 | 81 | 58 | 4.38 | |
| LlamaGen-3BLatent Representation=discrete, #tokens=576, codebook size=16384, #Params=3.1B, #Steps=576, Concurrent=true2024.09 | 2.18 | — | — | — | 263.3 | — | — | — | |
| RAETraining-free Encoder=true, Recon-Gen Tradeoff Control=false, Epochs=802026.05 | 2.23 | — | — | — | 214.8 | — | — | — | |
| RPiAETraining-free Encoder=false, Recon-Gen Tradeoff Control=false, Epochs=802026.05 | 2.25 | — | — | — | 208.7 | — | — | — | |
| DiT-XL/2-GClass=Diffusion2023.12 | 2.27 | — | — | — | 278.24 | 83 | 57 | — | |
| DiT-XL/2-GLatent Representation=continuous, #tokens=1024x4, #Params=675M, #Steps=250, Tokenizer training data=OpenImages, LAION-Aesthetics/-Humans2024.09 | 2.27 | — | — | — | 278.2 | — | — | — | |
| DiT-XL/2Epochs=1400, w/o Ext.=true, CFG=true2026.05 | 2.27 | — | — | — | 278.2 | 83 | 57 | 4.6 | |
| MaskDiTEpochs=1600, w/o Ext.=false, CFG=true2026.05 | 2.28 | — | — | — | 276.6 | 80 | 61 | 5.67 | |
| U-ViTLatent Representation=continuous, #tokens=1024x4, #Params=501M, #Steps=50, Tokenizer training data=OpenImages, LAION-Aesthetics/-Humans2024.09 | 2.29 | — | — | — | 263.9 | — | — | — | |
| StyleGAN-XLParam=166M, Epoch=-, Guidance=CG + cGAN, NFE=12025.11 | 2.3 | — | — | — | — | — | — | — | |
| AF-XL/2Param=673M, Epoch=125, Guidance=CG + DA, NFE=12025.11 | 2.38 | — | — | — | — | — | — | — | |
| GIVT-L-ALatent Representation=continuous, #tokens=256x32, #Params=1.67B, #Steps=2562024.09 | 2.59 | — | — | — | — | — | — | — | |
| AF-L/2Param=457M, Epoch=120, Guidance=CG + DA, NFE=12025.11 | 2.63 | — | — | — | — | — | — | — | |
| AlphaFlow-XL/2Param=676M, Epoch=240, Guidance=CFG, NFE=12025.11 | 2.81 | — | — | — | — | — | — | — | |
| AF-M/2Param=306M, Epoch=120, Guidance=CG + DA, NFE=12025.11 | 2.82 | — | — | — | — | — | — | — | |
| GAT-XL/2+REPAParam=602M, Epoch=40, Guidance=DA + cGAN, NFE=12025.11 | 2.96 | — | — | — | — | — | — | — | |
| RAEv2K=23, Training-free Encoder=true, Recon-Gen Tradeoff Control=true, Epochs=802026.05 | 3.02 | — | — | — | 206 | — | — | — | |
| ViT-VQGANLatent Representation=discrete, #tokens=1024, codebook size=8192, #Params=1.7B, #Steps=10242024.09 | 3.04 | — | — | — | 227.4 | — | — | — | |
| AF-B/2Param=130M, Epoch=200, Guidance=CG + DA, NFE=12025.11 | 3.05 | — | — | — | — | — | — | — | |
| DINO-SAETraining-free Encoder=false, Recon-Gen Tradeoff Control=false, Epochs=802026.05 | 3.07 | — | — | — | 209.7 | — | — | — | |
| DiffMoE-L + SharpMoE# Activated Params.=470M, # Total Params.=1.99B, cfg=1.5, Sampling Steps=2502026.06 | 3.1 | — | — | — | 228.88 | — | — | — | |
| SD-DiTEpochs=480, w/o Ext.=false, CFG=true2026.05 | 3.23 | — | — | — | — | — | — | — | |
| TiM-XL/2Param=664M, Epoch=300, Guidance=CFG, NFE=12025.11 | 3.26 | — | — | — | — | — | — | — | |
| EC-DiT-L + SharpMoE# Activated Params.=484M, # Total Params.=1.18B, cfg=1.5, Sampling Steps=2502026.06 | 3.27 | — | — | — | 221.36 | — | — | — | |
| ReDi-XL/2#Params=675M, Iter.=4M, Classifier-Free Guidance=false2026.04 | 3.3 | — | — | — | — | — | — | — | |
| CoReDi-XL/2#Params=675M, Iter.=2M, Classifier-Free Guidance=false2026.04 | 3.3 | — | — | — | — | — | — | — | |
| VFM-VAETraining-free Encoder=false, Recon-Gen Tradeoff Control=false, Epochs=802026.05 | 3.41 | — | — | — | 160.4 | — | — | — | |
| MeanFlow-XL/2Param=676M, Epoch=240, Guidance=CFG, NFE=12025.11 | 3.43 | — | — | — | — | — | — | — | |
| GigaGANParam=569M, Epoch=480, Guidance=Match-loss, NFE=12025.11 | 3.45 | — | — | — | — | — | — | — | |
| LDMLatent Shape=64x64x32023.10 | 3.6 | — | — | — | — | — | — | — | |
| LDM-4-GClass=Diffusion2023.12 | 3.6 | — | — | — | 247.67 | 87 | 48 | — | |
| LDM-4-GLatent Representation=continuous, #tokens=4096x3, #Params=400M, #Steps=250, Tokenizer training data=OpenImages2024.09 | 3.6 | — | — | — | 247.7 | — | — | — | |
| AlignTokTraining-free Encoder=false, Recon-Gen Tradeoff Control=false, Epochs=802026.05 | 3.71 | — | — | — | 148.9 | — | — | — | |
| TC-DiT-L + SharpMoE# Activated Params.=484M, # Total Params.=1.18B, cfg=1.5, Sampling Steps=2502026.06 | 3.72 | — | — | — | 206.93 | — | — | — | |
| RQ-TransformerLatent Representation=discrete, #tokens=256, codebook size=16384, #Params=3.8B, #Steps=642024.09 | 3.8 | — | — | — | 323.7 | — | — | — | |
| MeanFlow-L/2Param=459M, Epoch=240, Guidance=CFG, NFE=12025.11 | 3.84 | — | — | — | — | — | — | — | |
| DiffMoE-L# Activated Params.=458M, # Total Params.=1.98B, cfg=1.5, Sampling Steps=2502026.06 | 3.86 | — | — | — | 203 | — | — | — | |
| MaskGITLatent Representation=discrete, #tokens=256, codebook size=1024, #Params=177M, #Steps=82024.09 | 4.02 | — | — | — | 355.6 | — | — | — | |
| EC-DiT-L# Activated Params.=458M, # Total Params.=1.16B, cfg=1.5, Sampling Steps=2502026.06 | 4.09 | — | — | — | 195.12 | — | — | — | |
| Dense-DiT-L# Activated Params.=458M, # Total Params.=458M, cfg=1.5, Sampling Steps=2502026.06 | 4.74 | — | — | — | 183.54 | — | — | — | |
| MeanFlow-M/2Param=308M, Epoch=240, Guidance=CFG, NFE=12025.11 | 5.01 | — | — | — | — | — | — | — | |
| TC-DiT-L# Activated Params.=458M, # Total Params.=1.16B, cfg=1.5, Sampling Steps=2502026.06 | 5.07 | — | — | — | 174.98 | — | — | — | |
| AlphaFlow-B/2Param=131M, Epoch=240, Guidance=CFG, NFE=12025.11 | 5.4 | — | — | — | — | — | — | — | |
| Taming-VQGANLatent Representation=discrete, #tokens=256, codebook size=1024, #Params=1.4B, #Steps=2562024.09 | 5.88 | — | — | — | 304.8 | — | — | — | |
| REPA-XL/2#Params=675M, Iter.=4M, Classifier-Free Guidance=false2026.04 | 5.9 | — | — | — | — | — | — | — | |
| DINO-TokTraining-free Encoder=false, Recon-Gen Tradeoff Control=false, Epochs=802026.05 | 5.94 | — | — | — | 152.6 | — | — | — | |
| MeanFlow-B/2Param=131M, Epoch=240, Guidance=CFG, NFE=12025.11 | 6.17 | — | — | — | — | — | — | — | |
| DiffMoE-B + SharpMoE# Activated Params.=133M, # Total Params.=562M, cfg=1.5, Sampling Steps=2502026.06 | 6.66 | — | — | — | 155.64 | — | — | — | |
| BigGANParam=112M, Epoch=-, Guidance=cGAN, NFE=12025.11 | 6.95 | — | — | — | — | — | — | — | |
| EC-DiT-B + SharpMoE# Activated Params.=137M, # Total Params.=336M, cfg=1.5, Sampling Steps=2502026.06 | 7.67 | — | — | — | 144.5 | — | — | — | |
| DiffMoE-B# Activated Params.=130M, # Total Params.=559M, cfg=1.5, Sampling Steps=2502026.06 | 8.03 | — | — | — | 138.49 | — | — | — | |
| SiT-XL/2#Params=675M, Iter.=7M, Classifier-Free Guidance=false2026.04 | 8.3 | — | — | — | — | — | — | — | |
| FunctaLatent Shape=32x32x642023.10 | 8.8 | — | — | — | — | — | — | — | |
| TC-DiT-B + SharpMoE# Activated Params.=137M, # Total Params.=336M, cfg=1.5, Sampling Steps=2502026.06 | 9.28 | — | — | — | 130.52 | — | — | — | |
| EC-DiT-B# Activated Params.=130M, # Total Params.=329M, cfg=1.5, Sampling Steps=2502026.06 | 9.28 | — | — | — | 126.6 | — | — | — | |
| OursLatent Shape=256x2562023.10 | 9.3 | — | — | — | — | — | — | — | |
| Dense-DiT-B# Activated Params.=130M, # Total Params.=130M, cfg=1.5, Sampling Steps=2502026.06 | 10.07 | — | — | — | 122.15 | — | — | — | |
| Shortcut-XL/2Param=675M, Epoch=250, Guidance=CFG, NFE=12025.11 | 10.6 | — | — | — | — | — | — | — | |
| DiT + DiffusionBlocksBackbone=DiT-L/2, Layers=24, B (blocks)=3, Resolution=256x2562025.06 | 10.63 | — | — | — | — | — | — | — | |
| SpatialLatent Shape=16x16x2562023.10 | 11.7 | — | — | — | — | — | — | — | |
| DiTBackbone=DiT-L/2, Layers=24, Resolution=256x2562025.06 | 12.09 | — | — | — | — | — | — | — | |
| TC-DiT-B# Activated Params.=130M, # Total Params.=329M, cfg=1.5, Sampling Steps=2502026.06 | 12.82 | — | — | — | 104.37 | — | — | — | |
| DiffMoE-L + SharpMoE# Activated Params.=470M, # Total Params.=1.99B, cfg=1.0, Sampling Steps=2502026.06 | 13.93 | — | — | — | 93.66 | — | — | — | |
| EC-DiT-L + SharpMoE# Activated Params.=484M, # Total Params.=1.18B, cfg=1.0, Sampling Steps=2502026.06 | 14.82 | — | — | — | 88.02 | — | — | — | |
| DiffMoE-L# Activated Params.=458M, # Total Params.=1.98B, cfg=1.0, Sampling Steps=2502026.06 | 15.13 | — | — | — | 83.62 | — | — | — | |
| CoReDi-B/2#Params=130M, Iter.=400K, Classifier-Free Guidance=false2026.04 | 16.4 | — | — | — | — | — | — | — | |
| VeCoRBackbone=SiT-XL/2, NFEs=50, Sampling Method=Heun2, Resolution=256x2562025.11 | 16.55 | — | — | — | 76.17 | 65 | 62 | 7.21 | |
| EC-DiT-L# Activated Params.=458M, # Total Params.=1.16B, cfg=1.0, Sampling Steps=2502026.06 | 16.61 | — | — | — | 78.2 | — | — | — | |
| TC-DiT-L + SharpMoE# Activated Params.=484M, # Total Params.=1.18B, cfg=1.0, Sampling Steps=2502026.06 | 16.63 | — | — | — | 81.29 | — | — | — | |
| SiT-XL/2Backbone=SiT-XL/2, NFEs=50, Sampling Method=Heun2, Resolution=256x2562025.11 | 18.59 | — | — | — | 72.05 | 63 | 64 | 5.3 | |
| Dense-DiT-L# Activated Params.=458M, # Total Params.=458M, cfg=1.0, Sampling Steps=2502026.06 | 19.02 | — | — | — | 71.61 | — | — | — | |
| DiffMoE-S + SharpMoE# Activated Params.=34M, # Total Params.=141M, cfg=1.5, Sampling Steps=2502026.06 | 19.04 | — | — | — | 80.07 | — | — | — | |
| VeCoRBackbone=SiT-L/2, NFEs=50, Sampling Method=Heun2, Resolution=256x2562025.11 | 19.81 | — | — | — | 66.16 | 63 | 62 | 7.41 | |
| TC-DiT-L# Activated Params.=458M, # Total Params.=1.16B, cfg=1.0, Sampling Steps=2502026.06 | 20.53 | — | — | — | 69.01 | — | — | — | |
| TC-DiT-S + SharpMoE# Activated Params.=35M, # Total Params.=85M, cfg=1.5, Sampling Steps=2502026.06 | 20.55 | — | — | — | 73.94 | — | — | — | |
| DiffMoE-S# Activated Params.=33M, # Total Params.=140M, cfg=1.5, Sampling Steps=2502026.06 | 20.59 | — | — | — | 73.46 | — | — | — | |
| ReDi-B/2#Params=130M, Iter.=400K, Classifier-Free Guidance=false2026.04 | 21.4 | — | — | — | — | — | — | — | |
| EC-DiT-S + SharpMoE# Activated Params.=35M, # Total Params.=85M, cfg=1.5, Sampling Steps=2502026.06 | 21.81 | — | — | — | 70.56 | — | — | — |