Image Generation on CIFAR10 32x32 (test)
1.1FIDDiffusion StyleGAN2
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Diffusion StyleGAN22022.06 | 1.1 | — | — | 58 | — | — | — | — | |
| DiffiTClass=Diffusion, Space Type=Image2023.12 | 1.95 | — | — | — | — | — | — | — | |
| Separate CompressionRetention Ratio=1.0x, MACs=21.15G, Training Overhead=200N2026.04 | 1.97 | — | — | — | — | — | — | — | |
| EDM (VP)Class=Diffusion, Space Type=Image, Protocol=Variance Preserving (VP)2023.12 | 1.99 | — | — | — | — | — | — | — | |
| LSGMClass=Diffusion, Space Type=Latent2023.12 | 2.01 | — | — | — | — | — | — | — | |
| EDM (VE)Class=Diffusion, Space Type=Image, Protocol=Variance Exploding (VE)2023.12 | 2.01 | — | — | — | — | — | — | — | |
| LSGM (FID)Model Category=Likelihood-based2021.06 | 2.1 | — | 3.43 | — | — | — | — | — | |
| LSGMRepresentation Type=Discrete2024.01 | 2.1 | — | — | — | — | — | — | — | |
| Separate CompressionRetention Ratio=0.875x, MACs=18.47G, Training Overhead=200N2026.04 | 2.11 | — | — | — | — | — | — | — | |
| NCSN++ cont.Variant=deep, VE, Model Category=Likelihood-based2021.06 | 2.2 | 9.89 | 3.45 | — | — | — | — | — | |
| Score SDE (VE)NFE=2000, Time (s)=423.22022.11 | 2.2 | — | — | 59 | — | — | — | — | |
| Separate CompressionRetention Ratio=0.75x, MACs=15.98G, Training Overhead=200N2026.04 | 2.21 | — | — | — | — | — | — | — | |
| Separate CompressionRetention Ratio=0.625x, MACs=13.41G, Training Overhead=200N2026.04 | 2.28 | — | — | — | — | — | — | — | |
| OFA-Diffusion CompressionFine-tune=20K, Training Overhead=200 + 20N2026.04 | 2.29 | — | — | — | — | — | — | — | |
| OFA-Diffusion CompressionRetention Ratio=1.0x, MACs=21.15G, Training Overhead=2002026.04 | 2.3 | — | — | — | — | — | — | — | |
| UNCSN++ (RVE) + STSoft Truncation=true, Backbone=UNCSN++, Variant=RVE2021.06 | 2.33 | 10.11 | 3.04 | — | — | — | — | — | |
| DDPM++ cont.Variant=deep, sub-VP, Model Category=Likelihood-based2021.06 | 2.41 | 9.57 | 2.99 | — | — | — | — | — | |
| Score SDE (VP)NFE=2000, Time (s)=421.52022.11 | 2.41 | — | — | 59 | — | — | — | — | |
| OFA-Diffusion CompressionFine-tune=10K, Training Overhead=200 + 10N2026.04 | 2.41 | — | — | — | — | — | — | — | |
| DDPM++ (VP, FID) + STSoft Truncation=true, Backbone=DDPM++, Variant=VP, Target=FID2021.06 | 2.47 | 9.78 | 2.91 | — | — | — | — | — | |
| DDPM++(VP)Representation Type=Discrete2024.01 | 2.47 | — | — | — | — | — | — | — | |
| Separate CompressionTraining Overhead=200N2026.04 | 2.49 | — | — | — | — | — | — | — | |
| Separate CompressionRetention Ratio=0.5x, MACs=11.44G, Training Overhead=200N2026.04 | 2.5 | — | — | — | — | — | — | — | |
| SA-SolverNFE=952023.09 | 2.63 | — | — | — | — | — | — | — | |
| SA-SolverNFE=632023.09 | 2.74 | — | — | — | — | — | — | — | |
| Separate CompressionRetention Ratio=0.375x, MACs=9.42G, Training Overhead=200N2026.04 | 2.74 | — | — | — | — | — | — | — | |
| OFA-Diffusion CompressionTraining Overhead=2002026.04 | 2.75 | — | — | — | — | — | — | — | |
| Styleformer2021.06 | 2.82 | — | — | — | — | — | — | — | |
| StyleformerModel Category=Likelihood-free2021.06 | 2.82 | 9.94 | — | — | — | — | — | — | |
| Improved DDPM (Lsimple)Model Category=Likelihood-based2021.06 | 2.9 | — | 3.37 | — | — | — | — | — | |
| SA-SolverNFE=472023.09 | 2.92 | — | — | — | — | — | — | — | |
| StyleGAN2-ADA2021.06 | 2.92 | — | — | — | — | — | — | — | |
| StyleGAN2-ADA+TuningModel Category=Likelihood-free2021.06 | 2.92 | 10.02 | — | — | — | — | — | — | |
| StyleGAN2 w/ ADANFE=1, Time (s)=0.042022.11 | 2.92 | — | — | 49 | — | — | — | — | |
| StyleGAN2 + ADA2022.06 | 2.92 | — | — | 49 | — | — | — | — | |
| StyleGAN2 w/ ADAClass=GAN, Space Type=N/A2023.12 | 2.92 | — | — | — | — | — | — | — | |
| DDPM++ (VP)Class=Diffusion, Space Type=Image, Protocol=Variance Preserving (VP)2023.12 | 3.01 | — | — | — | — | — | — | — | |
| EDM (SDE)NFE=952023.09 | 3.06 | — | — | — | — | — | — | — | |
| INDMClass=Diffusion, Space Type=Latent2023.12 | 3.09 | — | — | — | — | — | — | — | |
| U-ViTClass=Diffusion, Space Type=Image2023.12 | 3.11 | — | — | — | — | — | — | — | |
| KLPolicy=π(x, σ)2026.02 | 3.18 | — | — | 72.5 | — | 77.3 | 17.7 | — | |
| DDPMNFE=1000, Time (s)=80.52022.11 | 3.21 | — | — | 57 | — | — | — | — | |
| rKLPolicy=π(x, σ)2026.02 | 3.21 | — | — | 71.6 | — | 78.1 | 30.5 | — | |
| PNDMModel Category=Likelihood-based2021.06 | 3.26 | — | — | — | — | — | — | — | |
| OFA-Diffusion CompressionFine-tune=20K, Retention Ratio=0.25x, MACs=6.06G, Training Overhead=200 + 20N2026.04 | 3.29 | — | — | — | — | — | — | — | |
| Naive OFATraining Overhead=2002026.04 | 3.34 | — | — | — | — | — | — | — | |
| EDM (SDE)NFE=632023.09 | 3.36 | — | — | — | — | — | — | — | |
| SA-SolverNFE=312023.09 | 3.4 | — | — | — | — | — | — | — | |
| FastDDPMNFE=50, Time (s)=4.012022.11 | 3.41 | — | — | 56 | — | — | — | — | |
| EDMPolicy=None2026.02 | 3.42 | — | — | 72.5 | — | 76.7 | 17 | — | |
| DDPM++ (VP, NLL) + STSoft Truncation=true, Backbone=DDPM++, Variant=VP, Target=NLL2021.06 | 3.45 | 9.19 | 2.88 | — | — | — | — | — | |
| KLPolicy=π(σ)2026.02 | 3.45 | — | — | 71.7 | — | 77.4 | 17 | — | |
| OFA-Diffusion CompressionFine-tune=10K, Retention Ratio=0.25x, MACs=6.06G, Training Overhead=200 + 10N2026.04 | 3.45 | — | — | — | — | — | — | — | |
| rKLPolicy=π(σ)2026.02 | 3.46 | — | — | 72.2 | — | 76.5 | 26.5 | — | |
| DeMe (After Merge)#Models=1, #Params=36.80M2024.10 | 3.51 | — | — | — | — | — | — | — | |
| EDM (SDE)NFE=472023.09 | 3.59 | — | — | — | — | — | — | — | |
| Separate CompressionRetention Ratio=0.25x, MACs=6.06G, Training Overhead=200N2026.04 | 3.6 | — | — | — | — | — | — | — | |
| DDGANNFE=4, Time (s)=0.212022.11 | 3.75 | — | — | 57 | — | — | — | — | |
| SA-SolverNFE=232023.09 | 3.77 | — | — | — | — | — | — | — | |
| DDPM++ (VE)Class=Diffusion, Space Type=Image, Protocol=Variance Exploding (VE)2023.12 | 3.77 | — | — | — | — | — | — | — | |
| EDM (ODE)NFE=472023.09 | 3.79 | — | — | — | — | — | — | — | |
| EDM (ODE)NFE=952023.09 | 3.79 | — | — | — | — | — | — | — | |
| DeMe (Before Merge)#Models=4, #Params=36.80M x 42024.10 | 3.79 | — | — | — | — | — | — | — | |
| EDM (ODE)NFE=632023.09 | 3.8 | — | — | — | — | — | — | — | |
| OMS-DPMTime budget (ms)=9.0 x 10^3, #Models=62024.10 | 3.8 | — | — | — | — | — | — | — | |
| EDM (ODE)NFE=312023.09 | 3.82 | — | — | — | — | — | — | — | |
| UniPCNFE=952023.09 | 3.89 | — | — | — | — | — | — | — | |
| UniPCNFE=632023.09 | 3.9 | — | — | — | — | — | — | — | |
| UniPCNFE=472023.09 | 3.91 | — | — | — | — | — | — | — | |
| DPM-SolverNFE=952023.09 | 3.94 | — | — | — | — | — | — | — | |
| EDM (SDE)NFE=312023.09 | 3.95 | — | — | — | — | — | — | — | |
| DPM-SolverNFE=632023.09 | 3.97 | — | — | — | — | — | — | — | |
| ScoreFlowVariant=VP, FID, Model Category=Likelihood-based2021.06 | 3.98 | — | 3.04 | — | — | — | — | — | |
| UniPCNFE=312023.09 | 4 | — | — | — | — | — | — | — | |
| WaveDiffNFE=4, Time (s)=0.082022.11 | 4.01 | — | — | 55 | — | — | — | — | |
| DPM-SolverNFE=472023.09 | 4.02 | — | — | — | — | — | — | — | |
| EDM (ODE)NFE=232023.09 | 4.04 | — | — | — | — | — | — | — | |
| OMS-DPMTime budget (ms)=6.0 x 10^3, #Models=62024.10 | 4.07 | — | — | — | — | — | — | — | |
| HSIVI-SMNFE=15, Backbone=UNet (Ho et al., 2020)2023.10 | 4.17 | — | — | — | — | — | — | — | |
| UniPCNFE=232023.09 | 4.19 | — | — | — | — | — | — | — | |
| DPM-SolverNFE=312023.09 | 4.3 | — | — | — | — | — | — | — | |
| HSIVI-SMNFE=10, Backbone=UNet (Ho et al., 2020)2023.10 | 4.31 | — | — | — | — | — | — | — | |
| Q-DiffusionBitwidth (W/A)=4/8, DDIM steps=2502025.08 | 4.37 | 9.64 | — | — | 4.59 | — | — | — | |
| TCECBitwidth (W/A)=4/8, DDIM steps=2502025.08 | 4.4 | 9.92 | — | — | 4.45 | — | — | — | |
| DDIMNFE=95, eta=02023.09 | 4.42 | — | — | — | — | — | — | — | |
| DDPM#Models=1, #Params=35.75M2024.10 | 4.42 | — | — | — | — | — | — | — | |
| OFA-Diffusion CompressionRetention Ratio=0.25x, MACs=6.06G, Training Overhead=2002026.04 | 4.42 | — | — | — | — | — | — | — | |
| QNCDBitwidth (W/A)=4/8, DDIM steps=2502025.08 | 4.43 | 9.78 | — | — | 4.51 | — | — | — | |
| Teacher2024.09 | 4.45 | 9.52 | — | — | 7.09 | — | — | — | |
| DPM-SolverNFE=232023.09 | 4.52 | — | — | — | — | — | — | — | |
| DDMIRepresentation Type=Continuous, Domain Specificity=Domain-agnostic2024.01 | 4.53 | — | — | — | — | — | — | — | |
| DDIMNFE=50, Time (s)=4.012022.11 | 4.67 | — | — | 53 | — | — | — | — | |
| DPM-Solver-fastNFE=15, Backbone=UNet (Ho et al., 2020)2023.10 | 4.67 | — | — | — | — | — | — | — | |
| EDM (SDE)NFE=232023.09 | 4.73 | — | — | — | — | — | — | — | |
| TCECBitwidth (W/A)=4/8, DDIM steps=1002025.08 | 4.79 | 9.65 | — | — | 4.91 | — | — | — | |
| DDIMNFE=63, eta=02023.09 | 4.83 | — | — | — | — | — | — | — | |
| QNCDBitwidth (W/A)=4/8, DDIM steps=1002025.08 | 4.85 | 9.53 | — | — | 5.06 | — | — | — | |
| SA-SolverNFE=152023.09 | 4.91 | — | — | — | — | — | — | — | |
| Q-DiffusionBitwidth (W/A)=4/8, DDIM steps=1002025.08 | 4.92 | 9.41 | — | — | 5.13 | — | — | — | |
| UniPCNFE=152023.09 | 5.02 | — | — | — | — | — | — | — |