# ENLighten: Lighten the Transformer, Enable Efficient Optical Acceleration

Source: [ENLighten: Lighten the Transformer, Enable Efficient Optical Acceleration](<https://www.sota2.com/research/paper/68fa7bd41e209131cea8ac35>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T05:49:23.746Z

Authors: Hanqing Zhu, Zhican Zhou, Shupeng Ning, Xuhao Wu, Ray Chen, Yating Wan, David Pan

Published: 2025-10-02T04:57:04.000Z

## Abstract

Photonic computing has emerged as a promising substrate for accelerating the dense linear-algebra operations at the heart of AI, yet adoption for large Transformer models remains in its infancy. We identify two bottlenecks: (1) costly electro--optic conversions and data-movement overheads that erode energy efficiency as model sizes scale; (2) a mismatch between limited on-chip photonic resources and Transformer scale, which forces frequent reuse of photonic tensor cores and dilutes throughput gains. To address these challenges, we introduce a hardware--software co-design framework. First, we propose \\texttt{Lighten}, a PTC-aware compression flow that post-hoc decomposes each Transformer weight matrix into a low-rank component plus a structured-sparse component aligned to photonic tensor-core granularity, without lengthy retraining. Second, we present \\texttt{ENLighten}, a reconfigurable photonic accelerator with dynamically adaptive tensor cores, driven by broadband light redistribution, enabling fine-grained sparsity support and full power gating of inactive parts. On ImageNet, \\texttt{Lighten} prunes a Base-scale Vision Transformer by 50\\% with $\\approx$1\\% accuracy drop after only 3 epochs (about 1 hour) of fine-tuning. Deployed on \\texttt{ENLighten}, it achieves a $2.5\\times$ improvement in energy--delay product over the state-of-the-art photonic Transformer accelerator.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2510.01673>)

[PDF](<https://arxiv.org/pdf/2510.01673.pdf>)
