Density Estimation on GAS d=8; N=1,052,065 (test)
12.06Avg Test Log-LikelihoodTAN
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| TANModel architecture=5x L+ReLU+SRNN+Re & RAM2018.01 | 12.06 | — | |
| TAN2019.04 | 12.06 | — | |
| B-NAFstacked flows=52019.04 | 12.06 | — | |
| NAF-DDSF2019.04 | 11.96 | — | |
| MAFNumber of transformations=102018.01 | 10.08 | — | |
| MAFNumber of layers=102017.05 | 10.08 | — | |
| MAF-affine2019.04 | 10.08 | — | |
| MAF MOGNumber of transformations=52018.01 | 9.59 | — | |
| MAF MoGNumber of layers=5, Output distribution=Mixture of Gaussians2017.05 | 9.59 | — | |
| MAF-affine MoG2019.04 | 9.59 | — | |
| MAFNumber of transformations=52018.01 | 9.07 | — | |
| MAFNumber of layers=52017.05 | 9.07 | — | |
| FFJORD2019.04 | 8.59 | — | |
| MADE MOG2018.01 | 8.47 | — | |
| MADE MoGOutput distribution=Mixture of Gaussians2017.05 | 8.47 | — | |
| MADE MoG2019.04 | 8.47 | — | |
| Real NVPNumber of transformations=102018.01 | 8.33 | — | |
| Real NVPNumber of layers=102017.05 | 8.33 | — | |
| Real NVP2019.04 | 8.33 | — | |
| Glow2019.04 | 8.15 | — | |
| Real NVPNumber of transformations=52018.01 | 4.78 | — | |
| Real NVPNumber of layers=52017.05 | 4.78 | — | |
| MADE2018.01 | 3.56 | — | |
| MADE2017.05 | 3.56 | — | |
| Gaussian2017.05 | -3.58 | — | |
| FFJORD2018.10 | — | -8.59 | |
| FFJORD2018.10 | — | -8.59 | |
| FFJORD# Param=279K, L (number of layers)=5, Training Batch size=10002022.12 | — | -8.59 | |
| Glow2018.10 | — | -8.15 | |
| Glow2018.10 | — | -8.15 | |
| JKO-iFlow# Param=114K, L (number of layers)=6, Training #Batches=6.08K, Training Batch size=50002022.12 | — | -9.43 | |
| MADE2018.10 | — | -3.56 | |
| MADE2018.10 | — | -3.56 | |
| MAF2018.10 | — | -10.08 | |
| MAF2018.10 | — | -10.08 | |
| MAF-DDSF2018.10 | — | -11.96 | |
| MAF-DDSF2018.10 | — | -11.96 | |
| OT-Flow# Param=127K, Training #Batches=52K, Training Batch size=20002022.12 | — | -9.2 | |
| Real NVP2018.10 | — | -8.33 | |
| Real NVP2018.10 | — | -8.33 | |
| TAN2018.10 | — | -11.19 | |
| TAN2018.10 | — | -11.19 |