# GMem: A Modular Approach for Ultra-Efficient Generative Models

Source: [GMem: A Modular Approach for Ultra-Efficient Generative Models](<https://www.sota2.com/research/paper/68fa76f11e209131cea70236>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-12-14T19:45:41.486Z

Authors: Yi Tang, Peng Sun, Zhenglin Cheng, Tao Lin

Published: 2024-12-11T21:23:24.000Z

## Abstract

Recent studies indicate that the denoising process in deep generative diffusion models implicitly learns and memorizes semantic information from the data distribution. These findings suggest that capturing more complex data distributions requires larger neural networks, leading to a substantial increase in computational demands, which in turn become the primary bottleneck in both training and inference of diffusion models. To this end, we introduce GMem: A Modular Approach for Ultra-Efficient Generative Models. Our approach GMem decouples the memory capacity from model and implements it as a separate, immutable memory set that preserves the essential semantic information in the data. The results are significant: GMem enhances both training, sampling efficiency, and diversity generation. This design on one hand reduces the reliance on network for memorize complex data distribution and thus enhancing both training and sampling efficiency. On ImageNet at $256 \\times 256$ resolution, GMem achieves a $50\\times$ training speedup compared to SiT, reaching FID $=7.66$ in fewer than $28$ epochs ($\\sim 4$ hours training time), while SiT requires $1400$ epochs. Without classifier-free guidance, GMem achieves state-of-the-art (SoTA) performance FID $=1.53$ in $160$ epochs with only $\\sim 20$ hours of training, outperforming LightningDiT which requires $800$ epochs and $\\sim 95$ hours to attain FID $=2.17$.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2412.08781>)

[PDF](<https://arxiv.org/pdf/2412.08781.pdf>)

[Implementation](<https://github.com/LINs-lab/GMem>)
