论文标题
在分层贝叶斯框架中的过度代表
Overcomplete representation in a hierarchical Bayesian framework
论文作者
论文摘要
在反问题和成像中,一个常见的任务是找到一个稀疏的解决方案,从某种意义上说,大多数组件都会消失。在压缩感测的框架内,已经证明了确保精确恢复的一般结果。实际上,通常将稀疏解决方案计算,将$ \ ell_1 $ penalizatization的最小二乘优化与适当的数值方案相结合以完成任务。贝叶斯层次模型提供了一种计算有效的替代方案,用于寻找线性反问题的稀疏解决方案,其中通过定义有条件的高斯先验模型,以先验参数遵守广义GAMMA分布来编码稀疏性。已证明一种迭代交替的顺序(IAS)算法可导致计算效率的方案,并与具有早期终止条件的Krylov子空间迭代结合使用,该方法特别适合大规模问题。在这里,贝叶斯的稀疏性方法扩展到了问题,其解决方案允许在诸如复合框架之类的过度系统中进行稀疏编码。结果表明,在未知的多个可能表示中,IAS算法,尤其是IT的混合版本,正在有效地识别最稀疏的解决方案。计算的示例表明,该方法不仅非常适合传统成像应用,而且适用于机器学习框架中的字典学习问题。
A common task in inverse problems and imaging is finding a solution that is sparse, in the sense that most of its components vanish. In the framework of compressed sensing, general results guaranteeing exact recovery have been proven. In practice, sparse solutions are often computed combining $\ell_1$-penalized least squares optimization with an appropriate numerical scheme to accomplish the task. A computationally efficient alternative for finding sparse solutions to linear inverse problems is provided by Bayesian hierarchical models, in which the sparsity is encoded by defining a conditionally Gaussian prior model with the prior parameter obeying a generalized gamma distribution. An iterative alternating sequential (IAS) algorithm has been demonstrated to lead to a computationally efficient scheme, and combined with Krylov subspace iterations with an early termination condition, the approach is particularly well suited for large scale problems. Here the Bayesian approach to sparsity is extended to problems whose solution allows a sparse coding in an overcomplete system such as composite frames. It is shown that among the multiple possible representations of the unknown, the IAS algorithm, and in particular, a hybrid version of it, is effectively identifying the most sparse solution. Computed examples show that the method is particularly well suited not only for traditional imaging applications but also for dictionary learning problems in the framework of machine learning.