论文标题
Sotto VOCE:具有差异隐私保证的联合语音识别
Sotto Voce: Federated Speech Recognition with Differential Privacy Guarantees
论文作者
论文摘要
语音数据的收集价格昂贵,并且对其来源非常敏感。通常情况下,组织独立收集小型数据集供自己使用,但通常这些数据对于机器学习的需求并不是表现。组织可以将这些数据集汇总在一起,并共同建立一个强大的ASR系统。但是,在明显的情况下,在知识产权损失以及存在于数据集中的个人的隐私方面,共享数据具有巨大的风险。在本文中,我们提供了一种潜在的解决方案,可以在多个组织中学习ML模型,在该组织中我们可以提供数学保证限制隐私损失。我们使用一种以差异性隐私技术为基础的联合学习方法。我们将其应用于Senone分类原型,并证明该模型随着私人数据的增加而改善,同时仍然尊重隐私。
Speech data is expensive to collect, and incredibly sensitive to its sources. It is often the case that organizations independently collect small datasets for their own use, but often these are not performant for the demands of machine learning. Organizations could pool these datasets together and jointly build a strong ASR system; sharing data in the clear, however, comes with tremendous risk, in terms of intellectual property loss as well as loss of privacy of the individuals who exist in the dataset. In this paper, we offer a potential solution for learning an ML model across multiple organizations where we can provide mathematical guarantees limiting privacy loss. We use a Federated Learning approach built on a strong foundation of Differential Privacy techniques. We apply these to a senone classification prototype and demonstrate that the model improves with the addition of private data while still respecting privacy.