Density Estimation on MNIST (test)
-3,408.16NLL (bits/dim)VAE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| VAE2019.10 | -3,408.16 | — | — | — | |
| PresGAN2019.10 | -1,432.5 | — | — | — | |
| GANentropy regularization (lambda)=02019.10 | -1,423.39 | — | — | — | |
| Residual Flow2019.06 | 0.97 | — | — | — | |
| MintNetType=Normalized, Single NFE=✓2026.05 | 0.98 | — | — | — | |
| FFJORDArchitecture=multi-scale convolutional architectures2018.10 | 0.99 | — | — | — | |
| FFJORD2018.11 | 0.99 | — | — | — | |
| FFJORD2019.06 | 0.99 | — | — | — | |
| FFJORDTraining Approach=Maximum Likelihood2020.07 | 0.99 | — | — | — | |
| FFJORDType=Normalized, Single NFE=✗2026.05 | 0.99 | — | — | — | |
| stNCE-s+DSMType=Estimate, Single NFE=✓, Time=0.272026.05 | 1 | — | — | — | |
| FFJORDParam=400K, Iter=60K2022.03 | 1.017 | 79.641 | 6.409 | 750.67 | |
| STEERParam=400K, Iter=60K2022.03 | 1.024 | 138.212 | 12.368 | 1,265.48 | |
| TO-FLOWParam=400K, Iter=60K2022.03 | 1.026 | 46.363 | 3.353 | 396.81 | |
| CTSM-vType=Estimate, Single NFE=✗2026.05 | 1.03 | — | — | — | |
| GlowArchitecture=multi-scale convolutional architectures2018.10 | 1.05 | — | — | — | |
| FFJORDArchitecture=single flow with a convolutional encoder-decoder architecture2018.10 | 1.05 | — | — | — | |
| Glow2018.11 | 1.05 | — | — | — | |
| Glow2019.06 | 1.05 | — | — | — | |
| i-ResNet2019.06 | 1.05 | — | — | — | |
| GlowTraining Approach=Maximum Likelihood2020.07 | 1.05 | — | — | — | |
| GLOW2022.05 | 1.05 | — | — | — | |
| GlowType=Normalized, Single NFE=✓2026.05 | 1.05 | — | — | — | |
| Real NVPArchitecture=multi-scale convolutional architectures2018.10 | 1.06 | — | — | — | |
| Real NVP2018.11 | 1.06 | — | — | — | |
| i-ResNet2018.11 | 1.06 | — | — | — | |
| Real NVP2019.06 | 1.06 | — | — | — | |
| Real NVPTraining Approach=Maximum Likelihood2020.07 | 1.06 | — | — | — | |
| I-RESNET2022.05 | 1.06 | — | — | — | |
| i-ResNetType=Normalized, Single NFE=✗2026.05 | 1.06 | — | — | — | |
| TREType=Estimate, Single NFE=✗2026.05 | 1.09 | — | — | — | |
| Sparse PC2022.11 | 1.14 | — | — | — | |
| HCLT2022.11 | 1.2 | — | — | — | |
| BitSwap2022.11 | 1.27 | — | — | — | |
| GFTraining Approach=Maximum Likelihood2020.07 | 1.29 | — | — | — | |
| TSMType=Estimate, Single NFE=✗2026.05 | 1.3 | — | — | — | |
| GISTraining Approach=Iterative2020.07 | 1.34 | — | — | — | |
| FCONV2 + NSFlayer_type=flowified convolutional, kernels=non-overlapping, activation=rational quadratic splines2022.05 | 1.35 | — | — | — | |
| BB-ANS2022.11 | 1.39 | — | — | — | |
| FCONV2layer_type=flowified convolutional, kernels=non-overlapping2022.05 | 1.41 | — | — | — | |
| stNCE-sType=Estimate, Single NFE=✓, Time=0.132026.05 | 1.61 | — | — | — | |
| RatSPN2022.11 | 1.67 | — | — | — | |
| RBIGTraining Approach=Iterative2020.07 | 1.71 | — | — | — | |
| MAF2018.10 | 1.89 | — | — | — | |
| MAF2018.11 | 1.89 | — | — | — | |
| MAFTraining Approach=Maximum Likelihood2020.07 | 1.89 | — | — | — | |
| IDF2022.11 | 1.9 | — | — | — | |
| MAF2022.05 | 1.91 | — | — | — | |
| McBits2022.11 | 1.98 | — | — | — | |
| MADE2018.10 | 2.04 | — | — | — | |
| MADE2018.11 | 2.04 | — | — | — | |
| FCONV1 + NSFlayer_type=flowified convolutional, kernels=overlapping, activation=rational quadratic splines2022.05 | 2.7 | — | — | — | |
| FP-DiffusionType=Normalized, Single NFE=✗2026.05 | 2.98 | — | — | — | |
| FCONV1layer_type=flowified convolutional, kernels=overlapping2022.05 | 3.11 | — | — | — | |
| FMLPlayer_type=flowified linear2022.05 | 4.19 | — | — | — | |
| NICE2018.11 | 4.36 | — | — | — | |
| stNCE-wType=Estimate, Single NFE=✓, Time=0.132026.05 | 4.56 | — | — | — | |
| stNCE-mType=Estimate, Single NFE=✓, Time=0.17*2026.05 | 4.92 | — | — | — | |
| tNCEType=Estimate, Single NFE=✓, Time=0.1272026.05 | 7.01 | — | — | — | |
| UHAK=642021.07 | 86.3 | — | — | — | |
| IWK=642021.07 | 86.6 | — | — | — | |
| IWK=322021.07 | 86.8 | — | — | — | |
| IWK=162021.07 | 87 | — | — | — | |
| UHAK=322021.07 | 87.3 | — | — | — | |
| IWK=82021.07 | 87.3 | — | — | — | |
| UHAK=162021.07 | 87.4 | — | — | — | |
| UHAK=82021.07 | 87.6 | — | — | — | |
| IWK=12021.07 | 88.3 | — | — | — | |
| UHAK=12021.07 | 88.4 | — | — | — |