论文标题
图像超分辨率的深度展开网络
Deep Unfolding Network for Image Super-Resolution
论文作者
论文摘要
基于学习的单图像超分辨率(SISR)方法在很大程度上是由于端到端培训,不断地显示出优于传统模型方法的效率和效率。但是,与可以在统一地图(最大后验)框架下以不同的比例因素(模糊内核和噪声水平)处理SISR问题的基于模型的方法不同,基于学习的方法通常缺乏这种灵活性。为了解决这个问题,本文提出了一个可端到端的可训练的展开网络,该网络利用基于学习的方法和基于模型的方法。具体而言,通过通过半季度拆分算法展开地图推断,可以获得包括交替求解数据子问题和先前子问题的固定数量的迭代。然后,这两个子问题可以用神经模块解决,从而导致端到端可训练的迭代网络。结果,所提出的网络继承了基于模型的方法通过单个模型对不同比例因素进行超级溶解模糊的嘈杂图像的灵活性,同时保持基于学习的方法的优势。广泛的实验表明,在灵活性,有效性和推广性方面,提出的深层展开网络的优越性。
Learning-based single image super-resolution (SISR) methods are continuously showing superior effectiveness and efficiency over traditional model-based methods, largely due to the end-to-end training. However, different from model-based methods that can handle the SISR problem with different scale factors, blur kernels and noise levels under a unified MAP (maximum a posteriori) framework, learning-based methods generally lack such flexibility. To address this issue, this paper proposes an end-to-end trainable unfolding network which leverages both learning-based methods and model-based methods. Specifically, by unfolding the MAP inference via a half-quadratic splitting algorithm, a fixed number of iterations consisting of alternately solving a data subproblem and a prior subproblem can be obtained. The two subproblems then can be solved with neural modules, resulting in an end-to-end trainable, iterative network. As a result, the proposed network inherits the flexibility of model-based methods to super-resolve blurry, noisy images for different scale factors via a single model, while maintaining the advantages of learning-based methods. Extensive experiments demonstrate the superiority of the proposed deep unfolding network in terms of flexibility, effectiveness and also generalizability.