Density Estimation on ImageNet 32x32 (test)
2.35Bits per Sub-pixelRNODE + STEER
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| RNODE + STEERPARAM=2.0M, TIME (GPU hours)=24.92021.06 | 2.35 | — | — | |
| RNODEPARAM=2.0M, TIME (GPU hours)=30.12021.06 | 2.36 | — | — | |
| NFDMforward process parameterization=non-Gaussian2024.04 | 3.34 | — | — | |
| NFDMforward process parameterization=Gaussian2024.04 | 3.36 | — | — | |
| i-DODE2024.04 | 3.43 | — | — | |
| Stochastic Interp.2024.04 | 3.48 | — | — | |
| RNODEre-implemented=true, PARAM=1.6M, TIME (GPU hours)=40.42021.06 | 3.49 | — | — | |
| RNODE + STEERre-implemented=true, PARAM=1.6M, TIME (GPU hours)=30.12021.06 | 3.49 | — | — | |
| Flow Matching2024.04 | 3.53 | — | — | |
| NDM2024.04 | 3.55 | — | — | |
| GATEDPIXELCNNautoregressive components=true2019.02 | 3.57 | — | — | |
| PIXELRNNautoregressive components=true2019.02 | 3.63 | — | — | |
| DenseFlowTIME (GPU hours)=3102021.06 | 3.63 | — | — | |
| MuLAN2024.04 | 3.67 | — | — | |
| VDMType=Diff, Evaluation Protocol=variational bound2021.07 | 3.72 | — | — | |
| VDM2024.04 | 3.72 | — | — | |
| ScoreFlowType=Diff, Evaluation Protocol=cont. norm. flow2021.07 | 3.76 | — | — | |
| Score Flow2024.04 | 3.76 | — | — | |
| 2-resolution MRCNFPARAM=1.3M, TIME (GPU hours)=18.22021.06 | 3.77 | — | — | |
| PixelCNN++Type=AR2021.07 | 3.77 | — | — | |
| 2-resolution MRCNFPARAM=6.7M, TIME (GPU hours)=182021.06 | 3.78 | — | — | |
| Hutchinsonprobes=22026.05 | 3.782 | 0.65 | 981 | |
| Hutchinsonprobes=12026.05 | 3.783 | 1 | 990 | |
| Very Deep VAEType=VAE2021.07 | 3.8 | — | — | |
| PixelCNNResolution=32x322017.03 | 3.83 | — | — | |
| Gated PixelCNNTIME (GPU hours)=602021.06 | 3.83 | — | — | |
| PixelCNNType=AR2021.07 | 3.83 | — | — | |
| FFJORD + STEERPARAM=2.0M, TIME (GPU hours)=>5days2021.06 | 3.84 | — | — | |
| SPNPARAM=150.0M2021.06 | 3.85 | — | — | |
| StAD2026.05 | 3.856 | 7.56 | 240 | |
| PixelRNNResolution=32x322017.03 | 3.86 | — | — | |
| FLOW++autoregressive components=false2019.02 | 3.86 | — | — | |
| Flow++variational dequantization=true2019.06 | 3.86 | — | — | |
| Flow++PARAM=169.0M2021.06 | 3.86 | — | — | |
| Flow++Type=Flow2021.07 | 3.86 | — | — | |
| ScoreFlowType=Diff, Evaluation Protocol=variational bound2021.07 | 3.86 | — | — | |
| NVAETIME (GPU hours)=702021.06 | 3.92 | — | — | |
| NVAEType=VAE2021.07 | 3.92 | — | — | |
| 3-resolution MRCNFPARAM=10.2M, TIME (GPU hours)=41.22021.06 | 3.93 | — | — | |
| Multiscale PixelCNNResolution=32x322017.03 | 3.95 | — | — | |
| BIVAautoregressive components=false, number of importance weighted samples=10002019.02 | 3.96 | — | — | |
| FFJORDre-implemented=true, PARAM=2.0M, TIME (GPU hours)=>5days2021.06 | 3.96 | — | — | |
| 3-resolution MRCNFPARAM=1.5M, TIME (GPU hours)=13.82021.06 | 3.97 | — | — | |
| BIVAautoregressive components=false, number of importance weighted samples=12019.02 | 3.98 | — | — | |
| Residual Flow2019.06 | 4.01 | — | — | |
| 3 x 3Epochs=600, Convolution Type=3x3 invertible convolutions2025.12 | 4.014 | — | — | |
| QuadEpochs=600, Convolution Type=3x3 invertible convolutions, Coupling Type=Quad-coupling2025.12 | 4.0377 | — | — | |
| MintNet2019.07 | 4.06 | — | — | |
| Wavelet FlowPARAM=64.0M2021.06 | 4.08 | — | — | |
| Glow2019.07 | 4.09 | — | — | |
| GLOWautoregressive components=false2019.02 | 4.09 | — | — | |
| Glow2019.06 | 4.09 | — | — | |
| GlowPARAM=66.1M2021.06 | 4.09 | — | — | |
| GlowType=Flow2021.07 | 4.09 | — | — | |
| GlowEpochs=6002025.12 | 4.09 | — | — | |
| EmergingEpochs=600, Convolution Type=Emerging convolutions2025.12 | 4.09 | — | — | |
| CONVDRAWautoregressive components=true2019.02 | 4.1 | — | — | |
| Real NVPResolution=32x322017.03 | 4.28 | — | — | |
| Real NVP2019.07 | 4.28 | — | — | |
| REALNVPautoregressive components=false2019.02 | 4.28 | — | — | |
| Real NVP2019.06 | 4.28 | — | — | |
| RealNVPPARAM=46.0M2021.06 | 4.28 | — | — | |
| Conv. DRAWResolution=32x322017.03 | 4.4 | — | — | |
| Image TransformerModel type=AR, Sampling=D2020.11 | 5.439 | — | — | |
| Very Deep VAEModel type=VAE, Params=119M, Depth=78, Sampling=12020.11 | 5.4822 | — | — | |
| Gated PixelCNNModel type=AR, Params=177M*, Depth=10, Sampling=D2020.11 | 5.5255 | — | — | |
| Flow++Model type=Flow, Params=169M, Sampling=12020.11 | 5.5688 | — | — | |
| NVAEModel type=VAE, Params=268M, Depth=28, Sampling=12020.11 | 5.6554 | — | — | |
| BIVAModel type=VAE, Params=103M*, Depth=15, Sampling=12020.11 | 5.7131 | — | — |