Density Estimation on binarized MNIST 28x28 (test)
81.3Test LogLPIXELCNN
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PIXELCNNAutoregressive components=true2019.02 | 81.3 | — | |
| BIVAAutoregressive components=false, Importance weighted samples=1, Fine-tuned=false2019.02 | 81.2 | — | |
| DISCRETE VAEAutoregressive components=false2019.02 | 81.01 | — | |
| DRAWAutoregressive components=true2019.02 | 80.97 | — | |
| BIVAAutoregressive components=false, Importance weighted samples=1, Fine-tuned=true2019.02 | 80.47 | — | |
| IAFVAEAutoregressive components=true2019.02 | 79.88 | — | |
| PIXELVAEAutoregressive components=true2019.02 | 79.66 | — | |
| PIXELRNNAutoregressive components=true2019.02 | 79.2 | — | |
| VLAEAutoregressive components=true2019.02 | 79.03 | — | |
| BIVAAutoregressive components=false, Importance weighted samples=1000, Fine-tuned=false2019.02 | 78.67 | — | |
| BIVAAutoregressive components=false, Importance weighted samples=1000, Fine-tuned=true2019.02 | 78.59 | — | |
| DARNnumber of hidden units=500, noise=adaNoise2014.06 | -84.13 | — | |
| DBNhidden layers=2, approximation=true2013.10 | -84.55 | — | |
| DBNnumber of hidden units=500h+2000h2014.06 | -84.55 | — | |
| EONADE-5 2HL(128 Ords)number of hidden layers=2, number of steps (k)=5, number of orderings=128, ensemble=true2014.06 | -84.68 | — | |
| DARNnumber of hidden units=5002014.06 | -84.71 | — | |
| EoNADEhidden layers=2, orderings=1282013.10 | -85.1 | — | |
| EONADE-mask 2HL(128 Ords)number of hidden layers=2, number of orderings=128, ensemble=true2014.06 | -85.1 | — | |
| EONADE-5 1HL(128 Ords)number of hidden layers=1, number of steps (k)=5, number of orderings=128, ensemble=true2014.06 | -86.23 | — | |
| RBMhidden units=500, CD steps=25, approximation=true2013.10 | -86.34 | — | |
| RBMnumber of hidden units=500, training=CD-252014.06 | -86.34 | — | |
| NADE-5 2HLnumber of hidden layers=2, number of steps (k)=52014.06 | -87.14 | — | |
| EoNADEhidden layers=1, orderings=1282013.10 | -87.71 | — | |
| EONADE-mask 1HL(128 Ords)number of hidden layers=1, number of orderings=128, ensemble=true2014.06 | -87.71 | — | |
| EoNADEhidden layers=2, orderings=22013.10 | -87.96 | — | |
| NADEhidden layers=1, ordering=fixed, activation=RLU, training=minibatch2013.10 | -88.33 | — | |
| NADEhidden layers=1, ordering=fixed, activation=sigm, training=minibatch2013.10 | -88.35 | — | |
| NADEhidden layers=1, ordering=fixed2013.10 | -88.86 | — | |
| NADE 1HL(fixed order)number of hidden layers=1, ordering=fixed2014.06 | -88.86 | — | |
| NADEhidden layers=22013.10 | -89.17 | — | |
| NADE-mask 2HLnumber of hidden layers=22014.06 | -89.17 | — | |
| NADEhidden layers=32013.10 | -89.38 | — | |
| NADEhidden layers=42013.10 | -89.6 | — | |
| NADE-mask 4HLnumber of hidden layers=42014.06 | -89.6 | — | |
| NADE-5 1HLnumber of hidden layers=1, number of steps (k)=52014.06 | -90.02 | — | |
| EoNADEhidden layers=1, orderings=22013.10 | -90.69 | — | |
| NADEhidden layers=12013.10 | -92.17 | — | |
| NADE-mask 1HLnumber of hidden layers=12014.06 | -92.17 | — | |
| NADEhidden layers=2, input masks=false2013.10 | -95.33 | — | |
| NADE 2HLnumber of hidden layers=2, ordering=random2014.06 | -95.33 | — | |
| NADEhidden layers=1, input masks=false2013.10 | -99.37 | — | |
| NADE 1HLnumber of hidden layers=1, ordering=random2014.06 | -99.37 | — | |
| MoBernoullisK=5002013.10 | -137.64 | — | |
| MoBernoullisK=102013.10 | -168.95 | — | |
| DARNnh=500, Tractability=Intractable2015.02 | — | 84.71 | |
| DARNnh=500, Noise=adaNoise, Tractability=Intractable2015.02 | — | 84.13 | |
| DARN (Intractable)Type=Intractable2020.06 | — | 84.13 | |
| DBMArchitecture=2 hidden layers, Tractability=Intractable2015.02 | — | 84.62 | |
| DBNArchitecture=2 hidden layers, Tractability=Intractable2015.02 | — | 84.55 | |
| EoNADEArchitecture=1 hidden layer, Orderings=128, Tractability=Tractable2015.02 | — | 87.71 | |
| EoNADEArchitecture=2 hidden layers, Orderings=128, Tractability=Tractable2015.02 | — | 85.1 | |
| EoNADE 2hlLayers=2hl, Orders=1282020.06 | — | 85.1 | |
| EoNADE-5 2hlLayers=2hl, Orders=1282020.06 | — | 84.68 | |
| Locally Masked Convolution (S-curve)Orders=12020.06 | — | 78.47 | |
| Locally Masked Convolution (S-curve)Orders=82020.06 | — | 77.58 | |
| MADEArchitecture=1 hidden layer, Masks=1, Tractability=Tractable2015.02 | — | 88.4 | |
| MADEArchitecture=2 hidden layers, Masks=1, Tractability=Tractable2015.02 | — | 89.59 | |
| MADEArchitecture=1 hidden layer, Masks=32, Tractability=Tractable2015.02 | — | 88.04 | |
| MADEArchitecture=2 hidden layers, Masks=32, Tractability=Tractable2015.02 | — | 86.64 | |
| MADE 2hlLayers=2hl, Orders=322020.06 | — | 86.64 | |
| MoBernoullisK=10, Tractability=Tractable2015.02 | — | 168.95 | |
| MoBernoullisK=500, Tractability=Tractable2015.02 | — | 137.64 | |
| NADEArchitecture=1 hidden layer, Ordering=fixed order, Tractability=Tractable2015.02 | — | 88.33 | |
| NADE2020.06 | — | 88.33 | |
| PixelCNN2020.06 | — | 81.3 | |
| PixelRNN2020.06 | — | 79.2 | |
| RBMArchitecture=500 h, CD steps=25, Tractability=Intractable2015.02 | — | 86.34 |