论文标题
具有多层条件特征调制的柔性图像Denoising
Flexible Image Denoising with Multi-layer Conditional Feature Modulation
论文作者
论文摘要
对于灵活的非盲图像denoising,现有的深网通常将嘈杂的图像和噪声级别映射作为输入,以通过单个模型处理各种噪声水平。但是,在这种解决方案中,仅部署噪声差异(即噪声水平),以调节第一层的卷积特征,并通过频道转换来调节卷积的变化,这在平衡噪声删除和细节保存方面受到限制。在本文中,我们通过将U-NET主链配备具有多层条件特征调制(CFM)模块的U-NET主链来介绍一种新颖的灵活图像enoising网络(CFMNET)。与仅在第一层中的频道转移相比,CFMNET可以通过部署多层CFM来更好地利用噪声级别信息。此外,每个CFM模块都将噪声图像和噪声水平图的横向特征作为输入,以在降噪和细节保存之间进行更好的权衡。实验结果表明,我们的CFMNET可以有效利用噪声水平信息进行柔性非盲脱诺,并且在定量指标和视觉质量方面对现有的深层图像DeNoising方法的表现有利。
For flexible non-blind image denoising, existing deep networks usually take both noisy image and noise level map as the input to handle various noise levels with a single model. However, in this kind of solution, the noise variance (i.e., noise level) is only deployed to modulate the first layer of convolution feature with channel-wise shifting, which is limited in balancing noise removal and detail preservation. In this paper, we present a novel flexible image enoising network (CFMNet) by equipping an U-Net backbone with multi-layer conditional feature modulation (CFM) modules. In comparison to channel-wise shifting only in the first layer, CFMNet can make better use of noise level information by deploying multiple layers of CFM. Moreover, each CFM module takes onvolutional features from both noisy image and noise level map as input for better trade-off between noise removal and detail preservation. Experimental results show that our CFMNet is effective in exploiting noise level information for flexible non-blind denoising, and performs favorably against the existing deep image denoising methods in terms of both quantitative metrics and visual quality.