论文标题

有效的自适应联合联合优化物联网的联合学习

Efficient Adaptive Federated Optimization of Federated Learning for IoT

论文作者

Chen, Zunming, Cui, Hongyan, Wu, Ensen, Xi, Yu

论文摘要

物联网(IoT)的扩散和广泛使用与感应,计算和通信功能相关的设备,激发了人工智能增强的智能应用程序。经典人工智能算法需要集中的数据收集和处理,这些数据收集和处理在现实的智能物联网应用程序中,由于日益增长的数据隐私问题和分布式数据集。联合学习(FL)已成为一个分布式隐私的学习框架,该框架使IoT设备能够通过共享模型参数训练全球模型。但是,由于频繁的参数传输引起的效率低下会大大降低FL性能。现有的加速算法由两种主要类型组成,包括本地更新,考虑通信与计算之间的权衡以及参数压缩之间的权衡,考虑到通信和精度之间的权衡。共同考虑了这两个权衡,并自适应地平衡了它们对融合的影响尚未解决。为了解决该问题,本文提出了一种新型有效的自适应联合优化(EAFO)算法,以提高FL的效率,该算法通过共同考虑两个变量来最大程度地减少学习错误,并使FL可以自适应地调整两个变量,并在计算,通信和精确度之间进行平衡。实验结果表明,与最先进的算法相比,提出的EAFO可以更快地达到更高的精度。

The proliferation of the Internet of Things (IoT) and widespread use of devices with sensing, computing, and communication capabilities have motivated intelligent applications empowered by artificial intelligence. The classical artificial intelligence algorithms require centralized data collection and processing which are challenging in realistic intelligent IoT applications due to growing data privacy concerns and distributed datasets. Federated Learning (FL) has emerged as a distributed privacy-preserving learning framework that enables IoT devices to train global model through sharing model parameters. However, inefficiency due to frequent parameters transmissions significantly reduce FL performance. Existing acceleration algorithms consist of two main type including local update considering trade-offs between communication and computation and parameter compression considering trade-offs between communication and precision. Jointly considering these two trade-offs and adaptively balancing their impacts on convergence have remained unresolved. To solve the problem, this paper proposes a novel efficient adaptive federated optimization (EAFO) algorithm to improve efficiency of FL, which minimizes the learning error via jointly considering two variables including local update and parameter compression and enables FL to adaptively adjust the two variables and balance trade-offs among computation, communication and precision. The experiment results illustrate that comparing with state-of-the-art algorithms, the proposed EAFO can achieve higher accuracies faster.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源