# Semantic Communication with Adaptive Universal Transformer

Source: [Semantic Communication with Adaptive Universal Transformer](<https://www.sota2.com/research/paper/68fa6b511e209131cea2d9f3>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-27T06:11:34.747Z

Authors: Qingyang Zhou, Rongpeng Li, Zhifeng Zhao, Chenghui Peng, Honggang Zhang

Published: 2021-08-20T11:36:24.000Z

## Abstract

With the development of deep learning (DL), natural language processing (NLP) makes it possible for us to analyze and understand a large amount of language texts. Accordingly, we can achieve a semantic communication in terms of joint semantic source and channel coding over a noisy channel with the help of NLP. However, the existing method to realize this goal is to use a fixed transformer of NLP while ignoring the difference of semantic information contained in each sentence. To solve this problem, we propose a new semantic communication system based on Universal Transformer. Compared with the traditional transformer, an adaptive circulation mechanism is introduced in the Universal Transformer. Through the introduction of the circulation mechanism, the new semantic communication system can be more flexible to transmit sentences with different semantic information, and achieve better end-to-end performance under various channel conditions.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2108.09119>)

[PDF](<https://arxiv.org/pdf/2108.09119.pdf>)
