Log-likelihood estimation on MNIST dynamically binarized (test)
82.9Log-LikelihoodIWAE
Evaluation results
| Method | Links | |
|---|---|---|
| IWAEautoregressive_components=false2019.02 | 82.9 | |
| CONVVAE+HVIautoregressive_components=false2019.02 | 81.94 | |
| LVAEautoregressive_components=false2019.02 | 81.74 | |
| BIVAautoregressive_components=false, importance_weighted_samples=1, finetuned=false2019.02 | 80.6 | |
| BIVAautoregressive_components=false, importance_weighted_samples=1, finetuned=true2019.02 | 80.06 | |
| DISCRETE VAEautoregressive_components=false2019.02 | 80.04 | |
| DRAW+VGPautoregressive_components=true2019.02 | 79.88 | |
| IAFVAEautoregressive_components=true2019.02 | 79.1 | |
| VLAEautoregressive_components=true2019.02 | 78.53 | |
| BIVAautoregressive_components=false, importance_weighted_samples=1000, finetuned=false2019.02 | 78.49 | |
| BIVAautoregressive_components=false, importance_weighted_samples=1000, finetuned=true2019.02 | 78.41 | |
| CARMS-IArchitecture=Nonlinear, Categories (C)=10, Latent variables=20, Samples per gradient step=102021.10 | -92.97 | |
| LOORFArchitecture=Nonlinear, Categories (C)=10, Latent variables=20, Samples per gradient step=102021.10 | -93.22 | |
| CARMS-GArchitecture=Nonlinear, Categories (C)=10, Latent variables=20, Samples per gradient step=102021.10 | -93.26 | |
| CARMS-GArchitecture=Nonlinear, Categories (C)=5, Latent variables=40, Samples per gradient step=52021.10 | -93.27 | |
| LOORFArchitecture=Nonlinear, Categories (C)=5, Latent variables=40, Samples per gradient step=52021.10 | -93.67 | |
| UNORDArchitecture=Nonlinear, Categories (C)=5, Latent variables=40, Samples per gradient step=52021.10 | -93.69 | |
| CARMS-IArchitecture=Nonlinear, Categories (C)=5, Latent variables=40, Samples per gradient step=52021.10 | -93.83 | |
| UNORDArchitecture=Nonlinear, Categories (C)=10, Latent variables=20, Samples per gradient step=102021.10 | -93.94 | |
| CARMS-GArchitecture=Nonlinear, Categories (C)=3, Latent variables=66, Samples per gradient step=32021.10 | -95.44 | |
| CARMS-IArchitecture=Nonlinear, Categories (C)=3, Latent variables=66, Samples per gradient step=32021.10 | -95.73 | |
| LOORFArchitecture=Nonlinear, Categories (C)=3, Latent variables=66, Samples per gradient step=32021.10 | -95.98 | |
| UNORDArchitecture=Nonlinear, Categories (C)=3, Latent variables=66, Samples per gradient step=32021.10 | -96.09 | |
| RODEOK=3, Training Steps=1M, Likelihood=Bernoulli2022.02 | -98.72 | |
| ARSMArchitecture=Nonlinear, Categories (C)=10, Latent variables=20, Samples per gradient step=102021.10 | -98.73 | |
| ARMSK=3, Training Steps=1M, Likelihood=Bernoulli2022.02 | -99.08 | |
| Double CVK=3, Training Steps=1M, Likelihood=Bernoulli2022.02 | -99.16 | |
| ARSMArchitecture=Nonlinear, Categories (C)=5, Latent variables=40, Samples per gradient step=52021.10 | -99.61 | |
| RODEOK=2, Training Steps=1M, Likelihood=Bernoulli2022.02 | -100.78 | |
| RELAXEvaluations per step=3, Training Steps=1M, Likelihood=Bernoulli2022.02 | -100.8 | |
| Double CVK=2, Training Steps=1M, Likelihood=Bernoulli2022.02 | -100.91 | |
| ARSMArchitecture=Nonlinear, Categories (C)=3, Latent variables=66, Samples per gradient step=32021.10 | -101.33 | |
| DisARMK=2, Training Steps=1M, Likelihood=Bernoulli2022.02 | -101.61 | |
| CARMS-GArchitecture=Linear, Categories (C)=10, Latent variables=20, Samples per gradient step=102021.10 | -102.88 | |
| CARMS-GArchitecture=Linear, Categories (C)=5, Latent variables=40, Samples per gradient step=52021.10 | -102.9 | |
| CARMS-IArchitecture=Linear, Categories (C)=10, Latent variables=20, Samples per gradient step=102021.10 | -103 | |
| UNORDArchitecture=Linear, Categories (C)=5, Latent variables=40, Samples per gradient step=52021.10 | -103.06 | |
| CARMS-IArchitecture=Linear, Categories (C)=5, Latent variables=40, Samples per gradient step=52021.10 | -103.12 | |
| LOORFArchitecture=Linear, Categories (C)=5, Latent variables=40, Samples per gradient step=52021.10 | -103.16 | |
| LOORFArchitecture=Linear, Categories (C)=10, Latent variables=20, Samples per gradient step=102021.10 | -103.19 | |
| UNORDArchitecture=Linear, Categories (C)=10, Latent variables=20, Samples per gradient step=102021.10 | -103.35 | |
| UNORDArchitecture=Linear, Categories (C)=3, Latent variables=66, Samples per gradient step=32021.10 | -104.73 | |
| CARMS-IArchitecture=Linear, Categories (C)=3, Latent variables=66, Samples per gradient step=32021.10 | -104.82 | |
| CARMS-GArchitecture=Linear, Categories (C)=3, Latent variables=66, Samples per gradient step=32021.10 | -104.9 | |
| LOORFArchitecture=Linear, Categories (C)=3, Latent variables=66, Samples per gradient step=32021.10 | -105.17 | |
| ARSMArchitecture=Linear, Categories (C)=5, Latent variables=40, Samples per gradient step=52021.10 | -105.73 | |
| ARSMArchitecture=Linear, Categories (C)=10, Latent variables=20, Samples per gradient step=102021.10 | -106.41 | |
| ARSMArchitecture=Linear, Categories (C)=3, Latent variables=66, Samples per gradient step=32021.10 | -106.85 |