# Image Modeling on ImageNet 64x64 (val)

Source: [Image Modeling on ImageNet 64x64 (val)](<https://www.sota2.com/research/sota/image-modeling-on-imagenet-64x64-val>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:53:17.672Z

Evaluation of Image Modeling performance (density estimation or likelihood) on the validation split of the ImageNet dataset downsampled to 64x64 resolution, typically measured using Negative Log-Likelihood (NLL).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Image Modeling |
| Dataset (including any stated split) | ImageNet 64x64 (val) |
| Metric | NLL (bits/dim) |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 11 of 11 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [NLL (bits/dim)](<https://www.sota2.com/research/sota/image-modeling-on-imagenet-64x64-val.md?metric=NLL%20(bits%2Fdim)>): Lower is better; unit: SCALAR.

## Recorded results

| Method | NLL (bits/dim) | Result date | Report paper |
| --- | --- | --- | --- |
| Perceiver AR | 3.4 | Not recorded | 68fa769c1e209131cea6e1b1 |
| MD4 | 3.4 | Not recorded | 68fa769c1e209131cea6e1b1 |
| Routing Transformer | 3.43 | Not recorded | 68fa769c1e209131cea6e1b1 |
| Sparse Transformer | 3.44 | Not recorded | 68fa769c1e209131cea6e1b1 |
| Gated PixelCNN | 3.57 | Not recorded | 68fa769c1e209131cea6e1b1 |
| PixelRNN | 3.63 | Not recorded | 68fa62b81e209131ce9fad7e |
| PixelRNN | 3.63 | Not recorded | 68fa769c1e209131cea6e1b1 |
| RESIDUAL FLOW | 3.76 | Not recorded | 68fa67c71e209131cea18461 |
| GLOW | 3.81 | Not recorded | 68fa67c71e209131cea18461 |
| FFJORD RNODE | 3.83 | Not recorded | 68fa67c71e209131cea18461 |
| REAL NVP | 3.98 | Not recorded | 68fa67c71e209131cea18461 |

### Perceiver AR

NLL (bits/dim): 3.4. Result ID: 6994465a3a6c3148491c35c4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa769c1e209131cea6e1b1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65aa1e209131cea0bc26.md>)

Recorded evaluation configuration: {"#Params":"770M"}. This record does not assert independent reproduction.

### MD4

NLL (bits/dim): 3.4. Result ID: 6994465a3a6c3148491c35c5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa769c1e209131cea6e1b1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa769c1e209131cea6e1b1.md>)

Recorded evaluation configuration: {"#Params":"198M"}. This record does not assert independent reproduction.

### Routing Transformer

NLL (bits/dim): 3.43. Result ID: 6994465a3a6c3148491c35c3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa769c1e209131cea6e1b1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68a21e209131cea1d4a0.md>)

[Implementation](<https://github.com/google-research/google-research/tree/master/routing_transformer>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Sparse Transformer

NLL (bits/dim): 3.44. Result ID: 6994465a3a6c3148491c35c2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa769c1e209131cea6e1b1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65aa1e209131cea0bc26.md>)

Recorded evaluation configuration: {"#Params":"152M"}. This record does not assert independent reproduction.

### Gated PixelCNN

NLL (bits/dim): 3.57. Result ID: 6994465a3a6c3148491c35c1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa769c1e209131cea6e1b1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa629e1e209131ce9fa3c3.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### PixelRNN

NLL (bits/dim): 3.63. Result ID: 698be0b4ecace47ef5598b99.

[Reporting paper](<https://www.sota2.com/research/paper/68fa62b81e209131ce9fad7e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62b81e209131ce9fad7e.md>)

Recorded evaluation configuration: {"Resolution":"64x64","Data Augmentation":false}. This record does not assert independent reproduction.

### PixelRNN

NLL (bits/dim): 3.63. Result ID: 6994465a3a6c3148491c35c0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa769c1e209131cea6e1b1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62b81e209131ce9fad7e.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RESIDUAL FLOW

NLL (bits/dim): 3.76. Result ID: 698d440e8b517eb4332038f4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa67c71e209131cea18461.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa680d1e209131cea19de3.md>)

Recorded evaluation configuration: {"Dequantization":"uniform"}. This record does not assert independent reproduction.

### GLOW

NLL (bits/dim): 3.81. Result ID: 698d440e8b517eb4332038f3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa67c71e209131cea18461.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa649e1e209131cea05a05.md>)

[Implementation](<https://github.com/openai/glow>)

Recorded evaluation configuration: {"Dequantization":"uniform"}. This record does not assert independent reproduction.

### FFJORD RNODE

NLL (bits/dim): 3.83. Result ID: 698d440e8b517eb4332038f1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa67c71e209131cea18461.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67c71e209131cea18461.md>)

Recorded evaluation configuration: {"Dequantization":"uniform","TIME":"64.1"}. This record does not assert independent reproduction.

### REAL NVP

NLL (bits/dim): 3.98. Result ID: 698d440e8b517eb4332038f2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa67c71e209131cea18461.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63351e209131ce9fd6b3.md>)

Recorded evaluation configuration: {"Dequantization":"uniform"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
