# Image modeling on FashionMNIST (test) Source: [Image modeling on FashionMNIST (test)]() Collection index: [llms.txt]() Data updated: 2026-03-04T15:07:06.192Z Evaluation of image modeling performance, such as density estimation or reconstruction quality, on the test split of the FashionMNIST dataset, typically measured using metrics like Bits/dim and RMSE. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Image modeling | | Dataset (including any stated split) | FashionMNIST (test) | | Metric | Bits/dim | | Unit | SCALAR | | Direction | Lower is better | | Results loaded | 24 of 24 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Bits/dim](): Lower is better; unit: SCALAR. - [RMSE](): Lower is better; unit: SCALAR. - [FID](): Lower is better; unit: SCALAR. - [MSE](): Lower is better; unit: SCALAR. ## Recorded results | Method | Bits/dim | Result date | Report paper | | --- | --- | --- | --- | | WARP | 0.59 | Not recorded | 68fa7ba21e209131cea89811 | | GRU | 0.66 | Not recorded | 68fa7ba21e209131cea89811 | | LSTM | 0.73 | Not recorded | 68fa7ba21e209131cea89811 | | Dalap | 1.23 | Not recorded | 698d5ec7c97a0b3e3b5e3f2e | | Dalap | 1.23 | Not recorded | 698d5ec7c97a0b3e3b5e3f2e | | Dlogistic | 1.37 | Not recorded | 698d5ec7c97a0b3e3b5e3f2e | | Laplace | 2.2 | Not recorded | 698d5ec7c97a0b3e3b5e3f2e | | Dnormal | 3.09 | Not recorded | 698d5ec7c97a0b3e3b5e3f2e | | Bitwise | 3.76 | Not recorded | 698d5ec7c97a0b3e3b5e3f2e | | Bitwise | 4.98 | Not recorded | 698d5ec7c97a0b3e3b5e3f2e | | Laplace | 5.84 | Not recorded | 698d5ec7c97a0b3e3b5e3f2e | | Dnormal | 7.91 | Not recorded | 698d5ec7c97a0b3e3b5e3f2e | ### WARP Bits/dim: 0.59. Result ID: 69a84a936dbb7075b94f4cc9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"runs":"Best across 3 runs with different seeds"}. This record does not assert independent reproduction. ### GRU Bits/dim: 0.66. Result ID: 69a84a936dbb7075b94f4cc7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"runs":"Best across 3 runs with different seeds"}. This record does not assert independent reproduction. ### LSTM Bits/dim: 0.73. Result ID: 69a84a936dbb7075b94f4cc8. [Reporting paper]() Recorded evaluation configuration: {"runs":"Best across 3 runs with different seeds"}. This record does not assert independent reproduction. ### Dalap Bits/dim: 1.23. Result ID: 6998c4be5698665ec4280386. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Dalap Bits/dim: 1.23. Result ID: 6998c4be5698665ec42803d7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"K":10}. This record does not assert independent reproduction. ### Dlogistic Bits/dim: 1.37. Result ID: 6998c4be5698665ec42803db. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"K":10}. This record does not assert independent reproduction. ### Laplace Bits/dim: 2.2. Result ID: 6998c4be5698665ec42803d9. [Reporting paper]() Recorded evaluation configuration: {"K":10}. This record does not assert independent reproduction. ### Dnormal Bits/dim: 3.09. Result ID: 6998c4be5698665ec42803da. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"K":10}. This record does not assert independent reproduction. ### Bitwise Bits/dim: 3.76. Result ID: 6998c4be5698665ec4280387. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Bitwise Bits/dim: 4.98. Result ID: 6998c4be5698665ec42803d8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"K":10}. This record does not assert independent reproduction. ### Laplace Bits/dim: 5.84. Result ID: 6998c4be5698665ec4280388. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Dnormal Bits/dim: 7.91. Result ID: 6998c4be5698665ec4280389. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.