论文标题
多尺度的深层压缩成像
Multi-Scale Deep Compressive Imaging
论文作者
论文摘要
最近,基于深度学习的压缩成像(DCI)超过了重建质量和更快的运行时间的常规压缩成像。尽管多尺度表现出优于单尺度的表现,但DCI的研究仅限于单尺度采样。尽管对单尺度图像进行了训练,但DCI倾向于偏爱与常规的多尺度抽样相似的低频组件,尤其是在低尺寸下。从这个角度来看,网络更容易通过多尺度采样体系结构学习多尺度功能。在这项工作中,我们提出了一个多尺度的深层压缩成像(MS-DCI)框架,该框架共同学习在多尺度上分解,采样和重建图像。引入了三相端到端训练方案,并具有初始和两个增强阶段,以证明多规模采样的效率并进一步改善重建性能。我们分析了分解方法(包括金字塔,小波和尺度空间),采样矩阵和测量结果,并显示了MS-DCI的经验益处,这些矩阵始终优于常规和深度学习方法。
Recently, deep learning-based compressive imaging (DCI) has surpassed the conventional compressive imaging in reconstruction quality and faster running time. While multi-scale has shown superior performance over single-scale, research in DCI has been limited to single-scale sampling. Despite training with single-scale images, DCI tends to favor low-frequency components similar to the conventional multi-scale sampling, especially at low subrate. From this perspective, it would be easier for the network to learn multi-scale features with a multi-scale sampling architecture. In this work, we proposed a multi-scale deep compressive imaging (MS-DCI) framework which jointly learns to decompose, sample, and reconstruct images at multi-scale. A three-phase end-to-end training scheme was introduced with an initial and two enhance reconstruction phases to demonstrate the efficiency of multi-scale sampling and further improve the reconstruction performance. We analyzed the decomposition methods (including Pyramid, Wavelet, and Scale-space), sampling matrices, and measurements and showed the empirical benefit of MS-DCI which consistently outperforms both conventional and deep learning-based approaches.