论文标题
通用线性模型的光谱初始化的近似消息传递
Approximate Message Passing with Spectral Initialization for Generalized Linear Models
论文作者
论文摘要
我们考虑通过广义线性模型获得的测量值估算信号的问题。我们专注于基于近似消息传递(AMP)的估计器,这是一个具有许多吸引人特征的迭代算法的家族:在适当的模型假设下可以简单地表征AMP在高维极限下的性能; AMP也可以根据信号条目的经验分布量身定制,并且对于各种估计问题,AMP猜想在所有多项式时间算法中都是最佳的。 但是,AMP的一个主要问题是,在许多模型(例如相检索)中,它需要一个初始化与地面真相信号相关,并且独立于测量矩阵。假设可以使用这种初始化通常是不现实的。在本文中,我们通过提出使用光谱估计器初始化的AMP算法来解决此问题。通过这样的初始化,标准AMP分析失败了,因为光谱估计器以复杂的方式取决于设计矩阵。我们的主要贡献是对AMP的性能进行严格的表征,并在高维极限的情况下进行频谱初始化。关键的技术思想是定义和分析首先产生频谱估计量的两相人造AMP算法,然后紧密近似于真实AMP的迭代。我们还提供了证明所提出方法的有效性的数值结果。
We consider the problem of estimating a signal from measurements obtained via a generalized linear model. We focus on estimators based on approximate message passing (AMP), a family of iterative algorithms with many appealing features: the performance of AMP in the high-dimensional limit can be succinctly characterized under suitable model assumptions; AMP can also be tailored to the empirical distribution of the signal entries, and for a wide class of estimation problems, AMP is conjectured to be optimal among all polynomial-time algorithms. However, a major issue of AMP is that in many models (such as phase retrieval), it requires an initialization correlated with the ground-truth signal and independent from the measurement matrix. Assuming that such an initialization is available is typically not realistic. In this paper, we solve this problem by proposing an AMP algorithm initialized with a spectral estimator. With such an initialization, the standard AMP analysis fails since the spectral estimator depends in a complicated way on the design matrix. Our main contribution is a rigorous characterization of the performance of AMP with spectral initialization in the high-dimensional limit. The key technical idea is to define and analyze a two-phase artificial AMP algorithm that first produces the spectral estimator, and then closely approximates the iterates of the true AMP. We also provide numerical results that demonstrate the validity of the proposed approach.