论文标题
$ 1/e $的故事:基于Aloha的且基于加强学习的随机访问,以延迟约束通信
The Story of $1/e$: ALOHA-based and Reinforcement-Learning-based Random Access for Delay-Constrained Communications
论文作者
论文摘要
由多媒体通信系统,触觉互联网和网络物理系统中实时应用程序的扩散激励,支持延迟受限的流量对于此类系统至关重要。在延迟约束的流量中,每个数据包都有一个艰难的截止日期。当它在截止日期之前未交付时,它将变得毫无用处,并将从系统中删除。在这项工作中,我们专注于设计随机访问方案,以用于延迟受限的无线通信。我们首先研究了三个基于ALOHA的方案,并证明系统在相应的最佳传输概率下均匀地收敛到$ 1/e $的系统及时吞吐量,与延迟无限的Aloha系统的众所周知的吞吐量限制相同。基于Aloha的方案无法实现渐近系统及时吞吐量超过$ 1/E $的基本原因是,所有Active Aloha站点都在任何插槽中都具有相同的概率访问该通道。为了超过$ 1/e $,我们提出了一种基于加强学习的基于延迟约束的无线通信的方案,称为RLRA-DC,在此方面,不同的电台仅通过与接入点进行交互,从而协作了不同的传输概率。我们的数值结果表明,对于数十个电台,RLRA-DC的及时吞吐量可能高达0.8,即使对于数千个电台,大于$ 1/e $的车站也可以达到0.6。
Motivated by the proliferation of real-time applications in multimedia communication systems, tactile Internet, and cyber-physical systems, supporting delay-constrained traffic becomes critical for such systems. In delay-constrained traffic, each packet has a hard deadline; when it is not delivered before its deadline is up, it becomes useless and will be removed from the system. In this work, we focus on designing random access schemes for delay-constrained wireless communications. We first investigate three ALOHA-based schemes and prove that the system timely throughput of all three schemes under corresponding optimal transmission probabilities asymptotically converges to $1/e$, same as the well-known throughput limit for delay-unconstrained ALOHA systems. The fundamental reason why ALOHA-based schemes cannot achieve asymptotical system timely throughput beyond $1/e$ is that all active ALOHA stations access the channel with the same probability in any slot. To go beyond $1/e$, we propose a reinforcement-learning-based scheme for delay-constrained wireless communications, called RLRA-DC, under which different stations collaboratively attain different transmission probabilities by only interacting with the access point. Our numerical result shows that the system timely throughput of RLRA-DC can be as high as 0.8 for tens of stations and can still reach 0.6 even for thousands of stations, much larger than $1/e$.