论文标题
联合学习MRI重建的生成图像先验
Federated Learning of Generative Image Priors for MRI Reconstruction
论文作者
论文摘要
多机构的努力可以促进培训深度MRI重建模型,尽管在成像数据的跨站点共享期间会出现隐私风险。最近引入了联合学习(FL),以通过启用分布式培训而无需传输成像数据来解决隐私问题。 MRI重建的现有FL方法采用条件模型通过对成像运算符的明确知识从被采样到完全采样的采集来映射。由于有条件的模型在不同的加速度或采样密度之间概括较差,因此必须在训练和测试之间固定成像运算符,并且通常在跨站点匹配它们。为了提高多机构合作的概括和灵活性,在这里,我们介绍了一种基于生成图像先验的联合学习(FedGimp)的新型MRI重建方法。 Fedgimp利用了两阶段的方法:先验生成MRI的跨站点学习,并针对特定于主题的成像算子注入。全局MRI先验是通过无条件的对抗模型来学习的,该模型综合了基于潜在变量的高质量MR图像。先验中的特异性通过产生特定地点潜伏期的映射子网保留。在推断期间,先验与特定于主题的成像算子相结合,以实现重建,并通过最大程度地减少数据一致性丢失来进一步适应单个测试样本。对多机构数据集的全面实验清楚地表明,基于条件模型以及传统的重建方法,FedGIMP对特定于现场和联合方法的概括性能提高。
Multi-institutional efforts can facilitate training of deep MRI reconstruction models, albeit privacy risks arise during cross-site sharing of imaging data. Federated learning (FL) has recently been introduced to address privacy concerns by enabling distributed training without transfer of imaging data. Existing FL methods for MRI reconstruction employ conditional models to map from undersampled to fully-sampled acquisitions via explicit knowledge of the imaging operator. Since conditional models generalize poorly across different acceleration rates or sampling densities, imaging operators must be fixed between training and testing, and they are typically matched across sites. To improve generalization and flexibility in multi-institutional collaborations, here we introduce a novel method for MRI reconstruction based on Federated learning of Generative IMage Priors (FedGIMP). FedGIMP leverages a two-stage approach: cross-site learning of a generative MRI prior, and subject-specific injection of the imaging operator. The global MRI prior is learned via an unconditional adversarial model that synthesizes high-quality MR images based on latent variables. Specificity in the prior is preserved via a mapper subnetwork that produces site-specific latents. During inference, the prior is combined with subject-specific imaging operators to enable reconstruction, and further adapted to individual test samples by minimizing data-consistency loss. Comprehensive experiments on multi-institutional datasets clearly demonstrate enhanced generalization performance of FedGIMP against site-specific and federated methods based on conditional models, as well as traditional reconstruction methods.