# Post-Training Quantization for Vision Mamba with k-Scaled Quantization and Reparameterization

Source: [Post-Training Quantization for Vision Mamba with k-Scaled Quantization and Reparameterization](<https://www.sota2.com/research/paper/68fa80441e209131cea9c718>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T06:58:25.948Z

Authors: Bo-Yun Shi, Yi-Cheng Lo, An-Yeu (Andy) Wu, Yi-Min Tsai

Published: 2025-01-28T06:22:30.000Z

## Abstract

The Mamba model, utilizing a structured state-space model (SSM), offers linear time complexity and demonstrates significant potential. Vision Mamba (ViM) extends this framework to vision tasks by incorporating a bidirectional SSM and patch embedding, surpassing Transformer-based models in performance. While model quantization is essential for efficient computing, existing works have focused solely on the original Mamba model and have not been applied to ViM. Additionally, they neglect quantizing the SSM layer, which is central to Mamba and can lead to substantial error propagation by naive quantization due to its inherent structure. In this paper, we focus on the post-training quantization (PTQ) of ViM. We address the issues with three core techniques: 1) a k-scaled token-wise quantization method for linear and convolutional layers, 2) a reparameterization technique to simplify hidden state quantization, and 3) a factor-determining method that reduces computational overhead by integrating operations. Through these methods, the error caused by PTQ can be mitigated. Experimental results on ImageNet-1k demonstrate only a 0.8-1.2\\% accuracy degradation due to PTQ, highlighting the effectiveness of our approach.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2501.16738>)

[PDF](<https://arxiv.org/pdf/2501.16738.pdf>)
