论文标题
LightFR:轻巧的联合建议,具有隐私矩阵分解
LightFR: Lightweight Federated Recommendation with Privacy-preserving Matrix Factorization
论文作者
论文摘要
Federated推荐系统(FRS)使许多本地设备能够在不传输本地原始数据的情况下共享共享模型,但已成为具有隐私优势的普遍推荐范式。但是,以前关于FRS的工作通过连续嵌入空间中的内部产品进行相似性搜索,当项目的规模极大时,这会导致效率瓶颈。我们认为,在联邦设置中的这种方案忽略了资源受限的用户设备(即存储空间,计算开销和通信带宽)的容量有限,并且使得在大型推荐系统中更难部署。此外,已经证明,服务器和客户之间以实现形式传输本地梯度可能会泄漏用户的私人信息。为此,我们提出了一个轻巧的联合推荐框架,其中具有隐私的矩阵分解,LightFR,能够通过在联合设置下利用学习为哈希技术来生成高质量的二进制代码,从而享受快速的在线推断和经济记忆消耗。此外,我们设计了一种有效的联合离散优化算法,以在服务器和客户端之间进行协作训练模型参数,这可以有效地防止恶意派对的现实价值梯度攻击。通过对四个现实世界数据集的广泛实验,我们表明我们的LightFR模型在建议准确性,推理效率和数据隐私方面优于几种最先进的FRS方法。
Federated recommender system (FRS), which enables many local devices to train a shared model jointly without transmitting local raw data, has become a prevalent recommendation paradigm with privacy-preserving advantages. However, previous work on FRS performs similarity search via inner product in continuous embedding space, which causes an efficiency bottleneck when the scale of items is extremely large. We argue that such a scheme in federated settings ignores the limited capacities in resource-constrained user devices (i.e., storage space, computational overhead, and communication bandwidth), and makes it harder to be deployed in large-scale recommender systems. Besides, it has been shown that transmitting local gradients in real-valued form between server and clients may leak users' private information. To this end, we propose a lightweight federated recommendation framework with privacy-preserving matrix factorization, LightFR, that is able to generate high-quality binary codes by exploiting learning to hash technique under federated settings, and thus enjoys both fast online inference and economic memory consumption. Moreover, we devise an efficient federated discrete optimization algorithm to collaboratively train model parameters between the server and clients, which can effectively prevent real-valued gradient attacks from malicious parties. Through extensive experiments on four real-world datasets, we show that our LightFR model outperforms several state-of-the-art FRS methods in terms of recommendation accuracy, inference efficiency and data privacy.