论文标题

智能互联网的深入强化学习基于移动边缘计算

Deep Reinforcement Learning Based Mobile Edge Computing for Intelligent Internet of Things

论文作者

Zhao, Rui, Wang, Xinjie, Xia, Junjuan, Fan, Liseng

论文摘要

在本文中,我们研究了智能互联网(IoT)的移动边缘计算(MEC)网络,其中多个用户具有一些由多个计算访问点(CAPS)辅助的计算任务。通过将某些任务卸载到CAPS上,可以通过减少延迟和能耗来提高系统性能,这是MEC网络中感兴趣的两个重要指标。我们通过通过深厚的强化学习算法智能地提出卸载策略来设计系统。在此算法中,深层Q-NETWORK用于自动学习卸载决策以优化系统性能,并且对神经网络(NN)进行了培训以预测从环境系统中生成训练数据的卸载动作。此外,我们采用带宽分配,以优化用户和帽子之间的链接的无线频谱,其中提出了几个带宽分配方案。此外,我们使用帽子选择来选择一个最佳帽子来协助用户的计算任务。最终提出了仿真结果,以显示拟议的增强学习卸载策略的有效性。特别是,通过拟议的基于强化学习的算法,可以大大降低潜伏期和能耗的系统成本。

In this paper, we investigate mobile edge computing (MEC) networks for intelligent internet of things (IoT), where multiple users have some computational tasks assisted by multiple computational access points (CAPs). By offloading some tasks to the CAPs, the system performance can be improved through reducing the latency and energy consumption, which are the two important metrics of interest in the MEC networks. We devise the system by proposing the offloading strategy intelligently through the deep reinforcement learning algorithm. In this algorithm, Deep Q-Network is used to automatically learn the offloading decision in order to optimize the system performance, and a neural network (NN) is trained to predict the offloading action, where the training data is generated from the environmental system. Moreover, we employ the bandwidth allocation in order to optimize the wireless spectrum for the links between the users and CAPs, where several bandwidth allocation schemes are proposed. In further, we use the CAP selection in order to choose one best CAP to assist the computational tasks from the users. Simulation results are finally presented to show the effectiveness of the proposed reinforcement learning offloading strategy. In particular, the system cost of latency and energy consumption can be reduced significantly by the proposed deep reinforcement learning based algorithm.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源