论文标题
矩阵平方根的低排名更新
Low-Rank Updates of Matrix Square Roots
论文作者
论文摘要
协方差矩阵具有稀疏矩阵和低等级扰动的结构在数据科学应用中无处不在。算法通常需要利用此类结构,避免经常需要立体时间和二次存储的昂贵矩阵计算。这通常是通过执行维护此类结构的操作来完成的,例如矩阵反转通过Sherman-Morrison-Woodbury配方。在本文中,我们考虑矩阵平方根和逆平方根操作。给定对矩阵的低等级扰动,我们认为对(反向)平方根的近似校正存在。我们这样做是通过建立在真实校正的特征值上的几何衰减。然后,我们继续将校正作为代数riccati方程的解,并讨论如何计算该方程的低级别解决方案。我们分析近似求解代数riccati方程时产生的近似误差,提供光谱和Frobenius Norm向前和向后误差界限。最后,我们描述了算法的几种应用,并在数值实验中证明了它们的效用。
Models in which the covariance matrix has the structure of a sparse matrix plus a low rank perturbation are ubiquitous in data science applications. It is often desirable for algorithms to take advantage of such structures, avoiding costly matrix computations that often require cubic time and quadratic storage. This is often accomplished by performing operations that maintain such structures, e.g. matrix inversion via the Sherman-Morrison-Woodbury formula. In this paper we consider the matrix square root and inverse square root operations. Given a low rank perturbation to a matrix, we argue that a low-rank approximate correction to the (inverse) square root exists. We do so by establishing a geometric decay bound on the true correction's eigenvalues. We then proceed to frame the correction as the solution of an algebraic Riccati equation, and discuss how a low-rank solution to that equation can be computed. We analyze the approximation error incurred when approximately solving the algebraic Riccati equation, providing spectral and Frobenius norm forward and backward error bounds. Finally, we describe several applications of our algorithms, and demonstrate their utility in numerical experiments.