论文标题

基于虚拟网络体系结构:DRL方法

Space-Air-Ground Integrated Multi-domain Network Resource Orchestration based on Virtual Network Architecture: a DRL Method

论文作者

Zhang, Peiying, Wang, Chao, Kumar, Neeraj, Liu, Lei

论文摘要

传统的地面无线通信网络不能为人工智能(AI)应用提供高质量的服务,例如由于部署,覆盖范围和容量问题而导致的智能运输系统(ITS)。太空空间集成网络(Sagin)已成为该行业的研究重点。与传统的无线通信网络相比,Sagin更加灵活和可靠,并且具有更大的覆盖范围和更高的无缝连接质量。但是,由于其固有的异质性,时间变化和自组织特征,Sagin的部署和使用仍然面临着巨大的挑战,其中异质资源的编排包括一个关键问题。基于虚拟网络体系结构和深度强化学习(DRL),我们将萨金的异质资源编排建模为多域虚拟网络嵌入(VNE)问题,并提出了Sagin跨域VNE算法。我们对Sagin的不同网络段进行建模,并根据Sagin和用户需求的实际情况设置网络属性。在DRL中,代理是由五层策略网络执行的。我们根据从Sagin提取的网络属性构建功能矩阵,并将其用作代理培训环境。通过训练,可以得出每个嵌入每个基础节点的概率。在测试阶段,我们根据此概率依次完成虚拟节点和链接的嵌入过程。最后,我们通过训练和测试验证算法的有效性。

Traditional ground wireless communication networks cannot provide high-quality services for artificial intelligence (AI) applications such as intelligent transportation systems (ITS) due to deployment, coverage and capacity issues. The space-air-ground integrated network (SAGIN) has become a research focus in the industry. Compared with traditional wireless communication networks, SAGIN is more flexible and reliable, and it has wider coverage and higher quality of seamless connection. However, due to its inherent heterogeneity, time-varying and self-organizing characteristics, the deployment and use of SAGIN still faces huge challenges, among which the orchestration of heterogeneous resources is a key issue. Based on virtual network architecture and deep reinforcement learning (DRL), we model SAGIN's heterogeneous resource orchestration as a multi-domain virtual network embedding (VNE) problem, and propose a SAGIN cross-domain VNE algorithm. We model the different network segments of SAGIN, and set the network attributes according to the actual situation of SAGIN and user needs. In DRL, the agent is acted by a five-layer policy network. We build a feature matrix based on network attributes extracted from SAGIN and use it as the agent training environment. Through training, the probability of each underlying node being embedded can be derived. In test phase, we complete the embedding process of virtual nodes and links in turn based on this probability. Finally, we verify the effectiveness of the algorithm from both training and testing.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源