论文标题

关于联合和多任务学习的能源和沟通效率的权衡

On the Energy and Communication Efficiency Tradeoffs in Federated and Multi-Task Learning

论文作者

Savazzi, Stefano, Rampa, Vittorio, Kianoush, Sanaz, Bennis, Mehdi

论文摘要

联邦学习(FL)的最新进展为设计新颖策略的设计铺平了道路,以同时利用网络设备之间的合作来解决多个学习任务。多任务学习(MTL)与传统的转移学习方法相比,跨任务的相关共同点提高了效率。通过共同学习多个任务,可以获得能源足迹的显着降低。本文首先介绍了由模型不稳定元学习(MAML)范式驱动的MTL流程的能源成本,并在分布式无线网络中实施。该论文针对的是群集的多任务网络设置,其中自动座代理学习不同但相关的任务。 MTL过程分为两个阶段:可以快速适应新任务的元模型的优化,以及一个特定于任务的模型适应阶段,其中学习过的元模型被转移到代理商并为特定任务量身定制。这项工作通过考虑在机器人化的环境中考虑多任务增强学习(RL)设置来分析影响MTL能量平衡的主要因素。结果表明,与传统方法相比,MAML方法可以减少至少2倍,而无需电感转移。此外,可以表明,无线网络中的最佳能量平衡取决于上行链路/下行链路和Sidelink通信效率。

Recent advances in Federated Learning (FL) have paved the way towards the design of novel strategies for solving multiple learning tasks simultaneously, by leveraging cooperation among networked devices. Multi-Task Learning (MTL) exploits relevant commonalities across tasks to improve efficiency compared with traditional transfer learning approaches. By learning multiple tasks jointly, significant reduction in terms of energy footprints can be obtained. This article provides a first look into the energy costs of MTL processes driven by the Model-Agnostic Meta-Learning (MAML) paradigm and implemented in distributed wireless networks. The paper targets a clustered multi-task network setup where autonomous agents learn different but related tasks. The MTL process is carried out in two stages: the optimization of a meta-model that can be quickly adapted to learn new tasks, and a task-specific model adaptation stage where the learned meta-model is transferred to agents and tailored for a specific task. This work analyzes the main factors that influence the MTL energy balance by considering a multi-task Reinforcement Learning (RL) setup in a robotized environment. Results show that the MAML method can reduce the energy bill by at least 2 times compared with traditional approaches without inductive transfer. Moreover, it is shown that the optimal energy balance in wireless networks depends on uplink/downlink and sidelink communication efficiencies.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源