论文标题
强大的深度学习启用文本的语义通信系统
A Robust Deep Learning Enabled Semantic Communication System for Text
论文作者
论文摘要
随着6G时代的出现,语义交流的概念引起了人们越来越多的关注。与传统的通信系统相比,语义通信系统不仅受到无线通信环境中存在的物理噪声的影响,例如额外的白色高斯噪声,而且还受到由于基于深度学习的系统的来源和性质而引起的语义噪声。在本文中,我们详细介绍了语义噪声的机理。特别是,我们将语义噪声分为两类:字面语义噪声和对抗性语义噪声。前者是由书面错误或表达歧义引起的,而后者是由通过语义通道在嵌入层中添加到嵌入层的攻击引起的。为了防止语义噪声影响语义通信系统,我们提出了一个强大的深度学习能力的语义通信系统(R-Deepsc),该系统利用校准的自我注意机制和对抗性训练来应对语义噪声。与仅考虑文本传输物理噪声的基线模型相比,提出的R-Deepsc在不同的信噪比下处理语义噪声方面取得了显着的性能。
With the advent of the 6G era, the concept of semantic communication has attracted increasing attention. Compared with conventional communication systems, semantic communication systems are not only affected by physical noise existing in the wireless communication environment, e.g., additional white Gaussian noise, but also by semantic noise due to the source and the nature of deep learning-based systems. In this paper, we elaborate on the mechanism of semantic noise. In particular, we categorize semantic noise into two categories: literal semantic noise and adversarial semantic noise. The former is caused by written errors or expression ambiguity, while the latter is caused by perturbations or attacks added to the embedding layer via the semantic channel. To prevent semantic noise from influencing semantic communication systems, we present a robust deep learning enabled semantic communication system (R-DeepSC) that leverages a calibrated self-attention mechanism and adversarial training to tackle semantic noise. Compared with baseline models that only consider physical noise for text transmission, the proposed R-DeepSC achieves remarkable performance in dealing with semantic noise under different signal-to-noise ratios.