# Tutorial on Variational Autoencoders

Source: [Tutorial on Variational Autoencoders](<https://www.sota2.com/research/paper/68fa690f1e209131cea1fe34>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T22:52:51.647Z

Authors: Carl Doersch

Published: 2016-06-19T21:02:30.000Z

## Abstract

In just three years, Variational Autoencoders (VAEs) have emerged as one of the most popular approaches to unsupervised learning of complicated distributions. VAEs are appealing because they are built on top of standard function approximators (neural networks), and can be trained with stochastic gradient descent. VAEs have already shown promise in generating many kinds of complicated data, including handwritten digits, faces, house numbers, CIFAR images, physical models of scenes, segmentation, and predicting the future from static images. This tutorial introduces the intuitions behind VAEs, explains the mathematics behind them, and describes some empirical behavior. No prior knowledge of variational Bayesian methods is assumed.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Hierarchical Generative Modeling on MNIST](<https://www.sota2.com/research/sota/hierarchical-generative-modeling-on-mnist.md>): Hierarchical Generative Modeling; MNIST; DP: 79.9.

- [Hierarchical Generative Modeling on Cifar10 32x32 (50k samples)](<https://www.sota2.com/research/sota/hierarchical-generative-modeling-on-cifar10-32x32-50k-samples.md>): Hierarchical Generative Modeling; Cifar10 32x32 (50k samples); DP: 10.5.

- [Hierarchical Generative Modeling on Fashion-Mnist](<https://www.sota2.com/research/sota/hierarchical-generative-modeling-on-fashion-mnist.md>): Hierarchical Generative Modeling; Fashion MNIST; DP: 44.3.

- [Hierarchical Generative Modeling on 20 Newsgroups text](<https://www.sota2.com/research/sota/hierarchical-generative-modeling-on-20-newsgroups-text.md>): Hierarchical Generative Modeling; 20 Newsgroups text; DP: 7.1.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1606.05908>)

[PDF](<https://arxiv.org/pdf/1606.05908.pdf>)
